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FOREWORD 


This  report  is  the  result  of  a  theoretical  development  and  examination  of  the  generalized 
adjoint  concept  and  the  conditions  under  which  systems  analysis  using  adjoints  is  valid.  The 
results  developed  in  this  report  are  useful  aids  for  the  analysis  and  modeling  of  physical 
systems,  including  the  development  of  guidance  and  control  algorithms,  and  in  developing 
simulations.  This  report  defines  and  develops  the  generalized  adjoint  of  an  input-output  system. 
The  generalized  adjoint  of  a  system  may  be  used  to  represent  the  inverse  of  a  system,  which 
may  be  used  in  systems  analysis.  Furthermore,  the  generalized  adjoint  condenses  system 
behavior  in  a  way  that  facilitates  analysis  of  the  effect  of  noise  and  disturbance  on  a  system. 
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which  became  this  report. 
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Systems  Engineering  Branch,  and  David  Richardson,  Plead,  Warfare  Systems  Development 
Division. 
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NOMENCLATURE 


U,  V 

Input,  Page  2-1 

utlvt,ut,vt 

Truncated  (past)  input,  Page  2-2 

OO  }  Vf, OO 

Future  input,  Page  2-3 

u 

Input  space,  Page  2-3 

ut 

Truncated  (past)  input  space,  Page  2-3 

Ut,00 

Future  input  space,  Page  2-3 

Y,Yt 

Output  space,  truncated  (past)  output  space,  Page  2-4 

F 

System  map,  Page  2-4 

T 

Space  of  system  maps 

Ft 

Truncated  system  map,  Page  2-4 

Ft 

Centered  truncated  system  map,  Page  2-4 

(Y,F,U) 

Input-output  system,  Definition  4 

Ya,Ua 

Generalized  adjoint  input  and  output  spaces 

pa 

Generalized  adjoint  map 

Ta 

Space  of  generalized  adjoint  maps 

( Ua,Fa,Ya ) 

Generalized  adjoint  system 

L  t,  Rt 

Left-,  right-shift  by  t,  Definition  1 

atu,  Ku 

a,  K  from  (5)  of  Definition  1,  associated  with  U 

Vn{U,Y) 

Bounded  operators  U  to  Y,  Page  2-6 

Cn(U,Y) 

Bounded,  continuous  operators  U  to  Y,  Page  2-6 

' 

Vector  norm 

IMIs,t 
i  •  i 

Fitted  Family  seminorm  over  (s,t),  Definition  1 

Operator  norm,  Equation  (2-5) 

-H- 

Splice,  Definition  3 

(t>:F^Fa 

The  generalized  adjoint  map 

A#,B# 

Auxiliary  input  and  output  spaces 

7  :U  ->  A# 

Input  space  to  auxiliary  input  space  map 

G,g 

Auxiliary  map;  space  of  auxiliary  maps 

p-.F^g 

System  to  auxiliary  system  map 

□ 

Indicates  the  end  of  a  proof 
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1  INTRODUCTION 


Generalized  adjoint  systems  are  defined  and  analyzed  in  this  report.  A  generalized  adjoint 
system  is  an  input-output  system  that  is  derived  from  a  given  causal  (possibly  nonlinear) 
input-output  system.  The  basic  properties  of  the  generalized  adjoint  system  are  that  it  is 
linear,  causal  (in  fact,  memoryless),  and  is  time  invariant  when  the  original  system  is  time 
invariant.  Given  a  space  of  causal  input-output  systems,  a  map  from  this  space  of  systems  to 
its  generalized  adjoints,  referred  to  as  the  adjoint  map,  is  defined.  The  adjoint  map  is 
bounded,  continuous,  and  preserves  translations.  Under  certain  conditions,  and  involving  the 
Hahn-Banach  theorem,  the  adjoint  map  has  a  bounded  and  continuous  inverse.  A 
representation  for  the  inverse  of  a  causal  input-output  system  in  terms  of  the  generalized 
adjoint  is  given.  It  is  seen  that  if  the  original  input-output  system  is  one  to  one/onto,  then  its 
generalized  adjoint  is  onto/one  to  one.  The  reverse  of  these  implications  may  be  obtained 
under  some  completeness  conditions.  In  the  first  step  of  developing  a  representation  of  the 
inverse  to  the  original  input-output  system  using  the  generalized  adjoint  system,  another 
input-output  system,  which  has  the  behavior  of  the  original  input-output  system,  is  defined. 
This  input-output  system  is  referred  to  as  the  auxiliary  input-output  system.  Conditions  for 
the  auxiliary  input-output  system  to  be  causal,  bounded,  and  continuous  are  given. 

Conditions  for  the  map  between  the  original  input-output  system  and  the  auxiliary 
input-output  system  to  be  invariant  with  respect  to  translations,  bounded,  continuous,  and  to 
have  a  continuous  inverse  are  given.  It  is  then  shown  that  the  generalized  adjoint  system  is  a 
representation  for  the  inverse  of  the  auxiliary  input-output  system  and  therefore  also  of  the 
original  input-output  system.  A  method  for  computing  noise  and  disturbance  bounds  for  an 
input-output  system  involving  the  generalized  adjoint  system  is  discussed.  An  example 
illustrating  Chapters  4,  5,  and  some  of  6  is  presented.  Portions  of  this  report  appeared  in  [8], 
[10],  and  [12]. 

A  rough  description  of  the  generalized  adjoint  system  is  illustrated  in  Figure  1.  A  precise 
description  is  given  in  Chapter  3.  It  is  best  to  keep  in  mind  the  construction  of  the  adjoint  of 
a  linear  transformation  in  Banach  space.  Let  B  =  {( Z ,  B ,  T)}  be  a  set  of  causal  input-output 
systems,  where  T  is  the  input  space  of  time  functions  and  Z  is  the  output  space  of  time 
functions  and  B  :  Y  — >  Z  is  the  system  map.  For  B  6  B,  a  truncated  input-output  system 
Bt  :  To  - ^  Zq  is  defined  for  each  t  £  3ft,  where  To  (Zq)  is  the  input  (output)  space  of  truncated 
time  functions  defined  up  to  time  zero.  In  this  scenario,  the  system  trajectory  t  — ►  Bt  may  be 
considered  as  a  time  function.  This  type  of  set,  namely  B,  will  be  the  input  space  of  a 
generalized  adjoint  system.  Now,  consider  a  causal  input-output  system  ( Y,F,U ).  A 
truncated  system  Ft  :  Uq  —>  To  may  be  defined  for  each  f  6  By  concatenating  a  B  &  B  with 
F.  another  causal  input-output  system  is  defined:  A  =  BF.  In  fact,  a  set  of  causal 
input-output  systems  A  =  {(Z,  A,  U)}  is  defined  by  concatenating  every  B  6  B  with  F.  The 
system  trajectories  t  — *  At  of  A  may  also  be  considered  as  time  functions.  A  generalized 
adjoint  system  is  defined  as  the  mapping  from  the  set  of  time  functions  B  to  the  set  of  time 
functions  A.  Denote  an  input  space  of  time  functions  Ya  =  {(Z,  B ,  T)}  and  an  output  space 
of  time  functions  Ua  =  {(Z,  A,  U)}.  Given  an  input-output  system  ( Y,F,U ),  its  generalized 
adjoint  is  Fa  :  Ya  — ►  Ua  defined  by  Fa(B )  =  A  =  BF.  The  generalized  adjoint  system  is 
( Ua,Fa,Ya ).  Consider  a  set  of  causal  input-output  systems  T  =  {(T,  F,  U)}.  A  generalized 
adjoint  map  with  domain  T  and  range  Ta  is  defined  by  4>(F)  =  Fa  for  all  F  £  T. 
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Figure  1:  The  Generalized  Adjoint  System 
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2  PRELIMINARIES 


This  chapter  presents  a  workable  definition  of  an  input-output  system.  An  input-output 
system  is  herein  denoted  (Y.  F,  U )  where  F  is  a  mapping  from  an  input  space  U  to  an  output 
space  Y,  and  where  U  and  Y  are  translation-invariant  spaces  of  vector-valued  time  functions. 
The  vector  values  of  these  time  functions  typically  are  $lN ,  N  =  1,  2,  ■  ■  ■ ,  but  only  need  to  be 
Banach  spaces.  Other  spaces  and  mappings  related  to  ( Y ,  F,  U )  will  be  introduced,  but  U  and 
Y  with  the  qualifying  affixes  they  carry  always  refer  to  input  and  output  spaces.  Mappings 
from  various  input  spaces  to  output  spaces  are  denoted  F.  again  with  qualifying  affixes. 

Among  the  properties  discussed  are  boundedness  and  continuity;  therefore,  a  topology 
with  metric  on  the  sets  (“spaces”)  involved,  including  the  spaces  of  mappings  must  be 
provided.  For  convenience  and  because  it  is  appropriate  to  deal  with  linear  spaces,  or  subsets 
thereof,  we  choose  to  do  this  by  introducing  norms  (or  semi-norms)  on  these  linear  spaces.  Of 
course,  the  introduction  of  particular  norms  is  arbitrary,  but  there  are  considerations  to  take 
into  account.  For  instance,  it  is  desirable:  (1)  to  have  generality  where  possible  (i.e.,  to  deal 
with  classes  of  norms  rather  than  specific  ones),  (2)  to  use,  or  permit  the  use  of,  norms  that 
are  readily  calculable,  and  (3)  to  use,  or  permit  the  use  of,  norms  that  yield  a  satisfactory 
interpretation  in  physical  problems  (an  admittedly  vague  statement).  From  these 
considerations  we  are  led  first  to  define  classes  of  norms  and  norrned  linear  spaces  to  be  used 
in  specifying  input  and  output  spaces  for  systems.  These  classes  are  referred  to  as  Fitted 
Families  (FFs)  of  norrned  linear  spaces.  Roughly  speaking,  fitted  families  work  like  Lp  norms 
on  time  functions  with  the  additional  feature  where  a  time  weighting  can  be  incorporated  so 
the  distant  past  of  an  input  or  output  time  function  may  be  de-emphasized.1  This  feature  is 
not  as  important  in  this  report  as  it  is  in  [11]  or  [13].  The  notation  ||uS)t||  .  indicates  the 
norm;  e.g.,  a  weighted  Lp  norm,  of  the  input  u  over  the  interval  of  time  (s,t\.  Usy  is  the  space 
of  inputs  over  the  same  interval.  FFs  were  initially  described  in  [6].  Additional  statements 
motivating  the  use  of  fitted  families  are  in  [9]. 

Definition  1  ([6])  Let  £  =  £(3ft,  E )  be  a  linear  space  of  time  functions  from  3ft  into  a  Banach 
space  E  such  that  any  translate  of  a  function  in  £  is  also  a  function  in  £.  Let 
Af  =  {||-||s  t ,  — oo  <  s  <  t  <  oo}  be  a  family  of  seminorms  on  £  satisfying  the 
following  conditions: 

(1)  For  fi,  f2  G  £,  if  /i(t)  =  /2(r)  for  s  <  r  <  t  then  ||/i  -  /2||Sjt  =  0. 

(2)  Let  Lr  denote  shift  to  the  left  by  r.  For  all  f  G  £,  \\LTf\\s_Tt_T  =  ||/||st. 

(3)  Let  r  <  s  <t.  Then  for  all  f  G  £,  \\f\\Sjt  <  ||/||r)t. 

(4)  Let  r  <  s  <  t.  Then  for  all  f  G  £,  \\f  \\rjt  <  \\f\\r^s  +  ||/||8it. 

(5)  There  exists  0  <  a  <  oo  and  JC  >  1  such  that,  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 

all  f  €  £,  ||/||riS</C||/||r)t. 

The  pair  (£,A f)  is  called  an  FF  of  seminorms  on  £.  The  norrned  linear  space  formed  from 
equivalence  classes  of  functions  in  £  with  norm  ||-||st  is  denoted  Hsj.  The  elements  of  HSjt 
are  the  equivalence  classes  determined  by:  f  ~  g,  f,g  G  £  if  and  only  if  \\f  —  g||st  =  0.  They 
are  denoted  usj,  ys,t >  etc.,  he.,  the  equivalence  classes  uSjt,  ys,t  represent  inputs  and  outputs 
respectively.  The  set  {Hs  t},  — oo  <  s  <  t  <  oo,  is  the  FF  of  norrned  linear  spaces 
given  by  (£,A f). 


^esoer  and  Vidyasagar  discuss  systems  theory  with  Lp  norms,  [1]. 
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A  fairly  wide  class  of  examples  of  FFs  is  given  by  weighted  Tp-spaces.  For  1  <  p  <  oo,  let 
w  be  a  fixed  nonnegative,  nonincreasing  Lebesgue  measurable  real-valued  function  and  let 
T  =  T(R,  9tN)  be  the  set  of  iV- vector- valued  functions  on  SR  that  are  p-integrable  Lebesgue  on 
finite  intervals.  Then,  for  /  6  £  the  seminorms 

ll/ll,,,  =  (/,|l/MP»(t-r)<ir)1/>>  (2-1) 

J  s 

satisfy  Conditions  (1),-  •  •  ,(5)  of  Definition  1.  For  p  =  oo  let  £  be  the  set  of  essentially 
bounded  functions.  When  a  =  +oo  and  fC  =  1,  (T,A f)  is  a  standard  FF  of  seminorms.  As 
time  weighting  was  not  essential  to  its  purpose,  standard  FFs  were  used  in  [9]. 

We  need  to  define  another  FF  of  seminorms.  For  /  £  T,  put  ||/||s,f  =  sups<T<t  ||/||ST. 

With  M  indicating  this  new  set  of  norms,  (T,  Ad)  is  indeed  an  FF  of  seminorms,  [5]. 

An  FF  (T,  A f)  and  {Hs  t},  — oo  <  s  <  t  <  oo,  can  be  augmented  to  include  IHU^  t  by 
taking  the  limit  s  — >  — oo,  since  by  (3)  of  Definition  1  ||/||  t  is  monotone  nondecreasing  as 
s  — ■>  — oo  with  t  fixed.  Let  To  =  {/  £  C\  lim^-oo  ||/||s  t  <  oo,  t  E  R}.  For  /  £  To,  define 

ll/ll,  =  11/11-00,.=  lim  ll/ll,,,  ■  (2-2) 

With  the  meaning  of  (T,A f)  thus  extended,  ||-||st  is  defined  for  — oo  <  s  <  t  <  oo.  The 
left-expanded  FF  of  seminorms  is  thereby  defined  and  is  denoted  (Cq,N).  It  still  satisfies  all 
the  Conditions  (1),  •  •  •  ,  (5). 

Define  Too  to  be  the  subset  of  To  such  that  for  /  £  Too  supt  ||/||t  <  oo.  Note  that  Too  is  a 
translation  invariant  linear  space.  For  /  £  Tooj  define 

11/IUoo  =  SUP  \\f\\s,t  ;  -oo  <  8  .  (2-3) 

t>s 

It  may  be  readily  verified  that  if  (T,A£)  is  an  FF  for  indices  satisfying  — oo  <  s  <  t  <  oo  then, 
with  definitions  given  by  (2-2)  and  (2-3),  (Too,  AT)  is  an  FF  for  indices  satisfying 
— oo  <  s  <  t  <  oo  and  satisfies  conditions  1,  2,  3,  and  5  of  Definition  1  for  indices 
— oo  <  s  <  t  <  oo.  (For  standard  FFs,  condition  4  holds  for  both  cases.) 

{(Too,  A£),  ||-||s  t ,  — oo  <  s  <  t  <  oo}  is  called  the  expanded  family  of  seminorms  determined 
by  (T,  AO-  Note  that  (Too,  Ad)  similarly  defined  is  an  FF  for  — oo  <  s  <t  <  oo. 

For  /  £  Too,  we  put 

ll/ll  =  sup  ll/llt  =  11/H-oo.oo  •  (2-4) 

teSR 

The  norrned  linear  space  consisting  of  equivalence  classes  of  functions  in  Too  with  the  norm 
(2-4)  is  called  the  bounding  space  FI  for  the  family  {Hs  i}. 

The  extended  space  Ffe  for  the  family  {Hsj}  is  the  set  of  all  equivalence  classes  of 
functions  /  in  To  (/  ~  g  iff  ||/  —  01  =  0)  f°r  which  ||/||s  <  oo  for  all  s.  It  does  not  have  a 
norm  and,  indeed,  is  given  no  topology.  This  definition  agrees  with  the  notion  of  extended 
space  commonly  used  in  the  control  literature. 

It  is  possible  that  an  FF  (T,A/")  has  a  vacuous  expansion  in  the  sense  that  Too  is  the  empty 
set.  An  obvious  example  of  this  is  given  when  T  is  the  set  of  all  constant  real  valued  functions 
on  R  and  J\f  is  the  set  of  Ti-norms  on  finite  intervals.  To  prevent  this  from  happening  and  to 
further  prevent  the  bounding  space  F[  from  being  too  small  (in  a  sense  to  be  made  explicit 
below),  we  can  require  that  an  FF  be  “full,”  as  indicated  in  the  following  definition. 
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Definition  2  The  FF  (£,  A f)  is  full  if  each  equivalence  class  uS)t  G  Hsj,  — oo  <  s  <  t  <  oo, 
has  a  representing  function  belonging  to  Coo- 

When  this  definition  is  satisfied,  then  for  all  pairs  (s,t),  — oo  <  s  <  t  <  oo  there  is  a  1:1 
correspondence  between  the  norrned  linear  space  Hsj  determined  by  (£,AA)  and  the  norrned 
linear  space  H'st  determined  by  (£00, A/"),  which  preserves  the  norrned  linear  space  structure. 
The  correspondence  is  given  by  usj  u's  t,  uSjt  G  Ust-  u's  t  G  H's  t  if  and  only  if  uSit  and  u's  t 
have  a  common  representing  function  /  G  Coo-  Thus,  if  (£,AT)  is  full,  we  need  not  distinguish 
between  Hst  and  H'st.  Henceforth,  every  FF  mentioned  is  assumed  to  be  full.  The  FFs 
formed  with  Lp  spaces  as  described  above  are  full. 

To  emphasize  the  relations  among  the  equivalence  classes,  suppose  the  function  /  G  £00 
determines  the  equivalence  classes  u  G  Ft,  vf  G  F[t,  ut  G  Ht  and  uSjt  G  Ffs  t.  Since 

11/  -  g\\s,t  <  11/  -  g\\t  <  11/  -  gtf  <  11/  -  g\\  , 

the  equivalence  class  u  considered  as  a  set  of  functions  is  entirely  contained  in  the  equivalence 
class  vf  considered  as  a  set  of  functions,  and  similarly  uf  C  ut  and  ut  C  usj,  also  u  C  ut,0° . 
Thus,  for  example,  given  t,  u  determines  lit  and  ut,0°.  Therefore,  if  /  determines  u  and 
—00  <  s  <  t  <  00  it  is  meaningful,  for  example,  to  write  ||/||st,  ||u||st,  ||r£||  ,  ||us,00||s  t, 

||ut||st,  ||uSjt||  .,  and  they  are  all  equal.  Let  —00  <  r  <  s  <  t  <  00.  Then,  since  ||/||st  <  ||/||rt 
for  /  G  £oO)  the  partitioning  of  £00  into  equivalence  classes  by  ||-||rt  results  in  a  finer  partition 
than  that  given  by  ||-||st.  That  is,  letting  /  determine  u  G  U,  we  have  u  C  ur_t  C  us }t- 

It  is  sometimes  necessary  to  consider  an  arbitrary  past  input  concatenated  with  an 
arbitrary  future  input,  i.e. ,  to  “splice”  two  inputs. 

Definition  3  ([6])  For  —00  <  r  <  s  <  t  <  00,  and  h,  g  G  £,  the  splice  of  h  and  g  over  (r,  t\ 
at  s  is  defined  and  equals  f  if 


r  <  r  <  s 
s  <  t  <  t 

—00  <  r  <  s  <  00,  the  splice  of  h  and  g  over 
r  <  t  <  s 

S  <  T 


If  urtS  G  Hr^s,  vS)t  G  FLs^t  are  determined  by  functions  h  and  g  respectively,  and  hr)S-\—>  gs,t 
exists,  then  for  an  FF,  the  splice  of  u  and  v  (or  ur,s  and  vsj)  over  (r,  t\  at  s  is  defined  to  be 
the  element  wr,t  G  Hr tt  determined  by  >  gs,t ;  we  write  wr,t  =  ur,s+^  vs,t-  For  t  =  00  we 
write  uv;0o  =  ur,Sjr^  vSj00.  These  are  not  meaningful  until  it  is  proved  that  the  splice  is 
independent  of  the  particular  functions  h  and  g  representing  the  equivalence  classes  ur,s  and 
vS)t-  However,  this  proof  follows  easily  from  Definition  1. 

Any  input  space  U  is  herein  taken  to  be  either  the  bounding  space  H  of  an  FF  that 

permits  splicing  or  a  translation-invariant  subset  of  H.  The  extended  space  F[e  can  appear  in 
an  auxiliary  role.  We  write  Us>t,  —00  <  s  <  t  <  00,  to  denote  the  set  (“space”)  of  equivalence 
classes  of  functions  belonging  to  £00  as  determined  by  ||-||s  t.  If  U  =  H,  then  Us,t  is  the 
norrned  linear  space  HS)p,  if  U  is  a  subset  of  FI ,  Us  t  is  a  space  only  in  the  sense  that  it  is  a 
subset  of  iLsy.  We  call  any  Us,t  a  truncated  input  space  and  write  Ut  for  U-ooj- 


fij)  = 


h(r), 

g(i~), 


belongs  to  C.  It  is  denoted  fr,t  =  gs,t-  For 

(r,  00]  at  s  equals  f  if 

h(r ), 


/(t)  = 


g{r), 


belongs  to  £.  It  is  denoted  fr i00  =  hr,s- 1-^  gs.c 
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The  requirement  that  H  permits  splicing  means  that,  if  U  =  H,  future  inputs  at  any  t  can 
be  arbitrary,  with  no  regard  to  the  past.  Unfortunately,  spaces  of  functions  everywhere 
continuous  on  3ft  do  not  qualify,  but  this  appears  to  be  a  minor  drawback.  It  is  sometimes 
desired  that  U  be  a  translation-invariant  bounded  (or  even  totally  bounded)  subset  of  H;  we 
always  assume  U  contains  the  zero  function.  When  U  is  a  proper  subset  of  H .  a  splice  of  two 
elements  in  U  does  not  necessarily  belong  to  U.  However,  we  require  that  for  all  u  6  U,  both 
vf- 1— ►  0tiOO  and  0*-| — >-  ut,oo  belong  to  U. 

The  output  space  Y  is  taken  to  be  the  bounding  space,  here  denoted  K,  of  an  FF  of 
norrned  linear  spaces  {Kst},  or  occasionally  the  corresponding  extended  space  I\e.  In  general, 
the  families  {Hst}  and  {Ksj}  need  not  be  the  same.  The  notations  for  output  spaces  are 
analogous  to  those  for  input  spaces.  The  comments  about  equivalence  classes  are  valid  for  the 

Vs,t  £  Ka,t- 

A  mapping  F  :  U  — >  Y  is  called  a  global  input-output  mapping  (or  usually  just  an 
input-output  mapping) . 

Definition  4  Let  (Y,  F,  U)  be  an  input-output,  system.  F  is  a  causal  mapping  and  (Y,  F,  U)  is 
a  causal  system  if  and  only  if  for  all  t  and  for  all  u,v  £  U  such  that  \\u  —  v\\t  =  0  it  follows 
that  llF’(u)  —  F(v)\\t  =  0. 

If  F  satisfies  this  definition  it  determines  a  mapping  from  Ut  into  Yj,  denoted  Ft,  that 
satisfies  Ftut  —  ( Fu)t  =  0.  We  call  Ft  a  truncated  input-output,  mapping  and  define  the 

centered  truncated  input-output,  mapping  Ft  :Uq  — >  Yq  by  Ft(uo)  =  LtFtRtfuo),  where 
Rt  =  L_t  is  the  right-shift  by  t.  We  assume  that  all  systems  in  this  report  are  causal.  If  F 
satisfies  this  definition,  it  is  causal  in  the  usual  sense.  However,  since  causality  is  defined  in 
terms  of  FFs,  systems  which  “look  like”  causal  systems  may  not  be.  Memory  can 
affect  causality. 

Definition  5  Consider  a  left- expanded  FF  {HSjt};  —  oo  <  s  <  t  <  oo.  The  family  {Hs  t}  and 
the  norms  ||-||t  are  said  to  be  finite  memory  with  memory  length  M  if  there  exists  0  <  M  <  oo 
such  that.  H/Hi  =  ||/||i_M;i  for  all  f  €  T0,  f  6  3ft. 

We  see  that  if  zu  in  (2-1)  has  finite  support,  i.e. ,  w(t)  =  0  for  t  >  M,  the  weighted  Lp 
norrned  linear  spaces  are  examples  of  finite  memory  spaces  with  memory  length  M.  Finite 
memory  may  cause  a  system  that  is  causal  in  the  usual  sense  to  not  be  causal  according  to 
Definition  4  because  of  the  nature  of  the  FF  defined  on  the  input  space  rather  than  the  nature 
of  the  system  itself.  This  does  not  happen  for  any  FF  where  ||u||t  =  0  implies  ||u||s  =  0  for  all 
s  <t  -  the  usual  case. 

The  next  step  in  setting  up  mathematical  structure  is  to  specify  norms  to  be  used  for 
input-output  mappings  Ft  and  Ft.  Although  Lipschitz  norms  might  seem  at  first  to  be  the 
obvious  choice,  we  much  prefer,  for  reasons  mentioned  below,  to  use  what  we  call  A-power 
norms,  introduced  in  [7]  (see  also  [10]).  The  A-power  norms,  denoted  |  •  |nvj,  are  defined  as 
follows.  Let  $  be  a  mapping  from  a  norrned  linear  space  X  into  a  norrned  linear  space  Y.  For 
any  nonnegative  integer  A,  a  norm  for  $  is  given  by 

=  sup  (2-5) 

X(zX  1  +  X 
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when  the  right  side  exists.  (We  omit  the  subscript  (IV)  when  possible).  We  say  $  is  bounded 
(in  N— power  norm)  if  [$|n\n  <  oo.  If  $  is  bounded,  it  carries  bounded  sets  into  bounded 
sets  by  the  inequality 

II4-WII  <  1*1  (*>•  (i  +  INI")- 

However,  boundedness  of  <I>  does  not  in  general  imply  continuity,  nor  vice  versa.  Other 
properties  of  these  norms  are  given  in  the  appendix  of  [9]  and  in  Appendix  A  of  [10]. 

Although  [9]  uses  the  standard  FFs,  its  appendix  also  applies  to  FFs  in  general.  There  is  also 
a  comparison  of  N— power  norms  and  Lipschitz  norms  in  these  appendices.  We  have  chosen  to 
use  IV-power  norms  rather  than  Lipschitz  norms  because  they  are  less  restrictive  and  they  are 
not  as  influenced  by  the  fine  structure  of  a  mapping.  This  last  property  has  relative 
importance  when  one  is  dealing  with  an  approximate  system  representation,  see  [3],  page  785. 

Using  (2-5)  on  the  truncated  system  mapping,  we  have 


1  1  (TV)  =  sup 

UO 


\\Ft  Milo 
i  +  Kilo" 


sup 

Ut 


Ft{ut)  ^ 

i  +  Kll" 


The  norm  for  the  global  input-output  mapping  may  be  defined  by 


(2-6) 


m*  =  sup 

U 


I  F(u) 


1  +  Ilit 


i  N 


(2-7) 


However,  in  this  report,  input-output  systems  are  themselves  used  as  inputs  to  the  generalized 
adjoint  systems.  Therefore,  the  norm  for  the  global  input-output  mapping  should  be  similar 
to  the  norm  for  an  input.  In  this  report,  the  global  input-output  mapping  is  defined  by 


1  F\  =  suplUtfo  =  sup  IF)  ]  —ool0  , 

t  t 


(2-8) 


[10].  There  is  further  elaboration  about  two  global  system  norms  (2-7)  and  (2-8)  in 
the  appendix. 

The  causal  bounded  input-output  mappings  are  denoted  by  T>n(U,Y).  The  following 
lemma  (a  special  case  of  Lemma  A.l  in  [10])  gives  conditions  so  T>n(U,  Y)  is  a  Banach  space. 

Lemma  6  ([10])  Let  T-^o  and  Y  be  Banach  spaces  where  0  <  b  <  oo.  Then  Vn(Uo,  Yl^o)  is 
a  Banach  space  with  norm  |  •  and  T>n(U,Y)  is  a  Banach  space  with  norm  |  •  '(. 

Definition  7  ([10])  An  input-output,  system  (Y,F,U),  F  £  T>n(U,Y)  is  compatibly 
continuous  if  the  truncated  maps  Ft  are  equicontinuous. 


Compatible  continuity  is  stronger  than  continuity  (it  implies  continuity).  However,  for  a 
linear  system  with  norm  defined  by  (2-8),  compatible  continuity  is  equivalent  to  boundedness. 
Denote  the  set  of  causal  bounded,  compatibly  continuous  input-output  systems  by  Cn(U,Y). 
It  may  be  shown  that  if  a  =  +oo,  0  £  U,  and  U  is  closed  with  respect  to  splicing,  compatible 
continuity  is  equivalent  to  continuity  [10].  These  results  are  derived  in  the  appendix. 

Throughout  this  report,  whenever  there  is  reference  to  a  system  (Y,  F,  U),  the  following 
three  hypotheses  are  in  effect  unless  otherwise  specifically  noted: 

(A)  The  input  space  U  is  either  the  bounding  space  H  of  an  FF  of  norrned  linear  spaces  that 
permits  splicing  or  a  shift-invariant  subset  of  such  an  A.  If  U  is  a  proper  subset  of  H , 
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we  require  that  it  contain  0,  but  also  that  u  £  U  implies  both  utjr*  Ch;00  and  utt00 
belong  to  U. 

(B)  The  output  space  Y  is  the  bounding  space  K  of  an  FF  of  norrned  linear  spaces. 

(C)  The  global  system  operator  F  satisfies  Definition  4  (causality)  with  respect  to  the  given 
H  and  K. 

The  next  hypothesis  will  often  be  needed  but  will  not  be  in  effect  unless  stated  explicitly. 

(D)  The  operators  Ft  :  Uq  —■ ►  Fo  are  uniformly  bounded  in  IV-power  norm  for  some  fixed 
positive  integer  N  by  a  constant  C  for  all  t  6  K,  and  are  an  equicontinuous  family  of 
uniformly  continuous  mappings. 

Hypothesis  (D)  implies  that  the  global  system  operator  is  bounded  with  bound  C  and 
uniformly  continuous  (see  Lemmas  4  and  5  of  [9]2).  Other  properties  resulting  from 
Hypothesis  (D)  are  given  in  [9]  and  [10]. 


2  Or,  F  £  Cn(U,Y)  and  is  uniformly  continuous.  The  proofs  given  in  [9]  were  intended  for  a  standard  FF: 
however,  such  proofs  usually  hold  for  FFs  in  general  if  Condition  5  of  Definition  1  is  not  used. 
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3  SPACES  OF  TIME  FUNCTIONS  CONSISTING  OF  INPUT-OUTPUT 

SYSTEMS 


The  input  space  of  time  functions  for  a  generalized  adjoint  system  is  discussed  in  this 
chapter.  The  time  functions  in  this  space  are  constructed  from  normalized  time  truncated 
system  trajectories.  Let  Z  and  Zq  be  Banach  spaces.  Then,  using  Lemma  6,  Cn(Y,Z)  and 
Cn(Yq,  Zq)  are  Banach  spaces.  Let  B  =  {(Z,  B,  Y)}  be  a  Banach  subspace  of  Cn(Y,  Z).  A 
truncated  system  Bt  :  Yq  —>  Zq  is  induced  by  each  U®.  (The  systems  in  B  are  causal.) 
Therefore,  the  system  trajectory  t  — ►  Bt  may  be  considered  as  a  time  function  from  3ft  to 
Cn(Yq,  Zq).  A  linear  space  of  time  functions  Eya),  where  Eya  =  Cm(Yq ,  Zq),  consisting  of 
the  time  functions  t  Bt  for  all  B  £  B  may  be  defined  by  using  the  addition  and  scalar 
multiplication  of  input-output  systems  in  Cjy(Y,  Z).  Consider  the  time  function  t  —>  Bt  in  the 
space  £(3t,  Eya).  The  left  translate  by  T  is  t  —*■  Bt+T-  This  defines  an  input-output  system 
B'  =  LyBRy.  Denote  this  translation  by  Lf.  Then  L*TB  =  B'  =  LyBRy.  It  is  assumed  that 
B  is  closed  with  respect  to  translations. 

The  splice  (Definition  3)  of  Bl,B 2  6  B  as  time  functions  at  T  £  K  is  the  time  function 
77(f)  £  £(K,  Eya)  given  by 


for  t  <  T 
for  t  >  T 


(3-1) 


The  splice  of  B1,  B 2  will  be  permitted  only  if  there  exists  B  £  B  such  that  r/(t)  =  Bt  for  all 
t  £  K.  A  condition,  which  serves  as  a  consistency  condition,  that  ensures  the  splice  of 
B1,  B2  £  Cn(Y,  Z)  at  time  T  is  permitted  is 


\\B2(y)-B\y)\\T=0  (3-2) 

for  all  y  £  Y.  The  splice  of  B1,  B 2  at  time  T,  if  it  is  permitted,  i.e. ,  (3-2)  is  satisfied,  gives  an 
input-output  system  B  £  Cn(Y,Z)  which  is  defined  by 


B{y)  =  ((B1)t-\  By00)(y)  ±  {B\y))T ^  ( B2(y))T, oo  •  (3-3) 

Note  that  even  if  B 1  and  B 2  are  time  invariant,  there  is  little  chance  that  ( Bl)T-\ — >  B^,  will 
be  time  invariant. 

Next,  an  FF  of  seminorms  will  be  defined  on  B.  Since  all  B  £  B  are  bounded  in  Cjy(Y,  Z), 
a  seminorm  |  ■  |  Syt  may  be  defined  on  B  by 


n„n  A  my)\Ut 

=  sup 


yeY  1  + 


(3-4) 


where  — oo  <  s  <  t  <  +oo.  In  this  report,  N  >  1;  the  case  N  =  0  is  considered  in  [10].  The 
following  proposition  gives  conditions  for  an  FF  of  seminorms  to  be  defined  on  B. 

Proposition  8  If  splicing  is  admissible  in  Y  and  ay  =  +oo,  JCy  =  1  (the  variables  a  and  K 
have  been  defined  in  Definition  1  and  the  subscripts  will  be  used  to  identify  them  with  a 
particular  space),  then  Af1  =  {|  •  |S)t;  — oo  <  s  <  t  <  oo}  is  an  FF  of  seminorms  defined  on  the 
Banach  space  of  causal  input-output  systems  B=  {(Z,  B,Y)j  viewed  as  time  functions. 

Proof:  Consider  properties  (1)  through  (5),  which  describe  an  FF  of  seminorms 
(see  Definition  1). 
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(1)  Let  Bl,B2  be  such  that  B\  =  B2  for  s  <  r  <  t,  then 


1 B1  -  B2\S)t  =  sup 

y& 


I B 


\y)  ~  B2{y ) 


s,t 


\N 

lit 


=  0  . 


(2)  Let  T  G  K 


\L*TB\s_Ttt_T  =  sup 


1  + Ill/ll 

\\LTBRT(y)\\s_Tt_T 


1  +  M?- 


t-T 


(3)  Let  r  <  s  <  t  : 


\\BRt(v)\\ 

y&Y  1  +  ||i?T2/|| 


=  sup 


si  =  i  bu 


\\B(y)  ||  s,t  11“  \tr/  nr,t  n  Dn 

M  =  SUP  :  .  ,,  „ N  ^  SUP.  . N  =  I Blr,t  • 


iBht  = 


\\B(y)  || 


•  DLip  - 77  OUp  - 

y^Yl  +  h\\t  yeY  l  +  \\y\\t 

(4)  Let  r  <  s  <  t  :  Since  ay  =  +oo,  JCy  =  1, 

l\B(y)\\r,t 


IBL,  = 


r,t  =  SUp 


y£Y  1  +  \\y\ 


i  N 


\\B(y)l 


< 


n—\&/iir,s  ll-®(y)lls,t 

<  sup  - L  +  sup  - jr 

y^Y  1  +  Ibllf  y^Y  1  +  Ibllf 
\\B(y)l 


,  \r.s  1 

<  SUp  -  M  •  SUP 


veYl  +  \\y\\'  yeYl  +  \\y\\? 
<  \B\r,s  +  lB\s,t  • 


N 

ls  +w\ 


s,t 


(5)  Let  r  <  s  <  t  and  t  —  r  <  az  : 


Wir.,  = 


\r,s  =  SUp 


\\B(y)l 


II B(ys-\ — >  0M)|| 


r,s 

Tv 


sup  - y  =  sup  - 

yeY  1  +  ||y||s  ys+^os,teYt  1  +  ||ysH — *  0 

y.  II B(ys~\  *  0S;t)|| rt  1  +  ||ys4 — *  0s,t||^ 

<  Hz  sup  - ■ - tt 

ya+^oa,teYt  1  +  || 2/sH — *  0S)t||4  1  +  ||ys-t — >  0S)t||s 

^  l|5(lft)||r>t  1  +  llz/sd — >0SX 

<  Hz  SUp  -  •  si  in  - 


sup  - jy  ■  SUp  - 

yt.eYt  1  +  ||yi||j  ys+^os,teYt  1  + 


l,7V 


<  lCZ\B\r,t  • 

Hence,  ay  a  =  az  and  /Cy«  =  Hz-  HI 

The  seminorms  |  •  [t  and  |  •  [  may  be  defined  from  |  •  [s  $  as  indicated  i 


lr 


Chapter  2. 


3-2 


NSWCDD/TR-12/79 


4  A  GENERALIZED  ADJOINT  SYSTEM 


The  generalized  adjoint  system  will  be  defined  and  some  of  its  properties  investigated.  Let 
(Y,  F,  U )  be  a  causal,  possibly  time-varying  input-output  system.  Assume  Y  and  Yq  are 
Banach  spaces  so  that,  as  a  consequence  of  Lemma  6,  Cn(U,Y )  and  Cn(Uq,Yq)  are  Banach 
spaces  with  N  >  1  (this  will  be  needed  in  Chapter  5,  where  the  generalized  adjoint  map  and 
its  invertibility  are  considered).  (The  case  N  =  0  is  considered  in  [10].)  Let  B  =  {(Z,  B,Y}) 
be  a  translation  invariant  closed  linear  subspace  of  causal,  bounded  input-output  systems 
defined  on  the  output  space  of  F.  Furthermore,  let  B  be  an  input  space  of  time  functions  as 
described  in  the  previous  chapter  with  N  =  1,  i.e.,  B  G  C\(Y,  Z )  for  all  B  G  B.  By 
concatenating  an  input-output  system  B  G  B  to  F,  a  causal  input-output  system  A  =  BF  is 
defined.  Note  that  A  is  an  element  of  Cn(U,  Z)  where  N  is  the  same  integer  as  is  used  for 
(Y,  F,  U ).  Let  A=Cn(U ,  Z)\  then  B  is  the  domain  and  A  is  the  counter  domain  of  the 
generalized  adjoint  system. 

Since  A  and  B  are  considered  as  spaces  of  time  functions,  we  will  need  that  they  be  FFs  of 
norrned  linear  spaces  as  described  by  Proposition  8.  To  verify  property  (4)  of  the  FFs,  it  was 
required  in  Proposition  8  that  ajj  =  +oo,  K,jj  =  1  and  ay  =  +oo,  /Cy  =  1.  (For  bounded 
range  systems,  i.e.,  ( Y,F,U )  G  Cq(U,Y),  this  requirement  is  not  necessary;  see  [10]).  However, 
property  (4)  is  not  used  in  the  subsequent  text;  therefore,  we  relax  these  conditions. 

The  above  conditions  are  in  force  throughout  this  report  (unless  otherwise  specifically 
stated).  In  summary  they  are: 

1.  F  G  Cn(U,Y)  and  Yq  and  Y  are  Banach  spaces,  N  >  1  (N  =  0  in  [10]). 3 

2.  B  G  C±(Y,  Z )  for  all  B  G  B  and  B  is  a  closed,  linear  subspace  of  C\(Y,  Z )  and  Zq  and  Z 
are  Banach  spaces. 

3.  A  =  Cn(U,Z). 

4.  A  and  B  are  translation  invariant. 

A  generalized  adjoint  system  is  defined  as  follows: 

Definition  9  A  generalized  adjoint  system  ( Ua,Fa,Ya )  of  a  causal  input-output  system 
(Y,  F ,  U )  has  domain  Ya  =  B  and  counter  domain  Ua  =  A  with  Fa  defined  by  Fa  :  Ya  — >  Ua, 
Fa(B)  =  A  =  BF. 

Proposition  10  gives  some  properties  of  generalized  adjoint  systems. 

Proposition  10  The  generalized  adjoint  system  Fa  of  a  causal  input-output,  system  F  is 
linear  and  memoryless  (hence,  causal).  Also ,  Fa  is  time  invariant  if  F  is  time  invariant. 

Proof:  Linearity:  Given  Bl,B2  G  B  and  scalars  a,  (3 

Fa(aB 1  +  f3B2)  =  ( aB 1  +  j3B2)F 


Hypothesis  (D)  provides  for  this  in  terms  of  conditions  on  the  truncated  systems.  As  stated  in  [9],  it  is  better 
to  have  hypotheses  in  terms  of  the  family  {Ft}  rather  than  F  because  the  mathematical  description  of  a  system 
is  usually  in  terms  of  Ft. 
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=  ( aBl)F  +  (/3  B2)F  =  a(B1F)  +  (3(B2F)  =  aFa(B1)  +  (3Fa{B2). 
Memoryless:  Let  B1,  B2  G  B  be  such  that  |  B 1  —  B2\sj  =  0  for  — oo  <  s  <  t  <  oo  then, 

\\B1F(u)-B2F(u)\\st 


lFa{BL)-Fa(B2)l,t  =  sup 


N 


<  sup 

U 


“  1  +  |Kt 

(S1-S2)(Fu)||  1  +  ||F(u)|| 


N 


1  +  ||F(u)||t  1  +  ||U||t 

<  IB1  -  B%,t  ■  (1  +  lF\t)  =  0. 

Hence,  the  system  Fa  is  a  memoryless  system. 

Time  Invariance:  Assume  F  is  time  invariant: 

L*s(Fa(R*sB))  =  L*s(Fa(RsBLs)) 

=  LSRSBLSFRS  =  BLSFRS  =  BF  =  Fa(B). 

Hence,  the  system  Fa  is  a  time  invariant  system.  □ 

Since  Fa  is  causal,  a  truncated  adjoint  system  :  Yta  — >  Ufj  may  be  defined  by 

Fta(Bt)  =  ( FaB)t  =  ( BF)t  =  BtFt 

where  Bt  G  Bt  and  t  G  K.  The  normalized  truncated  adjoint  system  F :  Yq  — ►  Uq  is  defined  by 

Fta(B0)  =  L*tFta(R*tB0)  =  L*tR*tB0Ft  =  B0Ft. 

Since  Fjj  is  linear  (shown  similarly  as  for  Fa  in  Proposition  10),  the  usual  linear  norm  is  used 
for  Fjl  and  []Fa|]  =  supjFf  |0,  (see  2-8). 

Proposition  11  For  F  G  Cn(U,Y),  Fa  and  are  bounded. 

Proof:  ,F“  is  uniformly  continuous:  Let  Bq,Bq  G  B,  then 

fFf  (Ho1)  -  F“(Hq)[o  =  I BlFt  -  B2Ft ]0 

\(B0  ~  Bo)Ft(uo)\\0 


=  \(B10-B2)Ft}0  =  sup 

uqGUq 


i  +  IMIS' 


=  sup 


iBo  Bo)Ft(u-o)||0  1  +  ||Bt('Uo)||c 


1  +  \\uo\\o 


uoSo  l  +  l|BtM||0 

<  D-Bq  -  B02Io  •  (1  +  \Ftlo)  <  IB1  -  HqIo  •  (1  +  |FI) 

Equation  (4-1)  shows  that  FJj  are  equicontinuous;  hence,  Fa  is  compatibly  continuous 
(Definition  7)  and  Fa  is  bounded  (see  Lemma  A-6).  □ 


(4-1) 


4-2 


NSWCDD/TR-12/79 


5  A  GENERALIZED  ADJOINT  MAP 


Consider  the  Banach  space  of  causal,  bounded,  compatibly  continuous  input-output 
systems  T  =  {(Y,  F,  U)}  C  Cn(U,  Y ),  all  of  which  have  the  same  input  space  U  and  the  same 
output  space  Y .  Fix  an  input  space  of  causal  input-output  systems  B  =  {(Z,  B ,  Y)}  and 
assume  the  hypotheses  listed  in  Chapter  4  hold.  Define  an  adjoint  map  cj)  with  domain  T  by 
0(F)  =  Fa.  Let  the  range  of  0  be  denoted  by  Ta  =  0(F).  All  adjoint  systems  Fa  E  Fa  will 
have  common  domain  Ya  and  common  counter  domain  Ua.  Note  that  0  is  dependent  on  B , 
but  is  well  defined  when  B  is  fixed.  Let  the  norm  on  0  be  given  by 


i  +  m 


First,  we  show  that  0  is  bounded  and  translation  preserving.  Recall  that  since  Fa  is  linear 
and  \Fa\  =  supt|Ft°[o  =  sup^jFf (R0)Io/I-BoIo- 


Proposition  12  |0|  <  1. 


Proof: 


10(F)!  _  IF“I 
7 1  +  IF!  7 1  +  IF! 


=  sup 
F 


sup  sup 
t  Bo 


Ii?(£o)lo  „  „  l^oFilo 

i^olo  TbT  \Bolo 

—  =  sup  - 
F 


<  sup 
F 


1  +  1*1  F  1  +  1  +  1 

(l  +  lFtIo)-!Fo|o 

—  =  1 .  □ 


sup  sup 
t  Bo 


IB, 


o|o 


1  +  1+1 


Proposition  13  0  preserves  translation.  (Note  that  the  left-translate  of  Fa  by  T  is 

T  *  TT'a  TT*  ) 

AjrpJP  J  . 


Proof:  For  B  eYa 

0(F0F)F  =  (j)(LTFRT)B 
=  (LtFRtYB  =  BLtFRt  =  LtRtBLtFRt 
=  L*t(RtBLtF)  =  L*T(Fa(RTBLT)) 

=  L*T(Fa(R*TB ))  =  (L00(F)F0)F  ; 
hence,  0  preserves  translation.  □ 

A  sufficient  condition  for  0  to  be  one  to  one  is:  For  all  distinct  yi,y2  &  Y,  there  exists 
B  E  B  such  that  B(y\)  /  B(y 2).  (Other  sufficient  conditions  are  given  later.)  Also,  it  may  be 
seen  that  if  all  B  E  Ya  are  linear,  then  0  is  linear. 

The  Lipschitz  norm  of  0  is 


1 0 1  Lip 


!0(F1)  -  0(F2)B 

F1,F2eJr  1+1  —  +21 


(5-1) 
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Lemma  14  If  in  addition  to  the  aforementioned  hypotheses  all  B  E  B  are  Lipschitz 
continuous,  4>  is  continuous. 


Proof:  We  have: 


sup  sup 
t  B0ev0a 


1  cfiF1)  -  cj>{F2)\ 
I]  ( F^a  "  F2a )  Bq  [|  q 
I^olo 


=  |Fla  - 
=  sup  sup 

t  Bo 


F2a  1 

iBoF?  -  B0F2 Iq 

l^oDo 


=  sup 

t,Bo 


sup 

Uo 


(BpF^uo)  -  (F0Ff2)(u0)|| 


1  +  ||uo 


I N 

lo 


I^olc 


I^olc 


<  sup 

t,Bo 


sup 

u0 


|F/(«0)-i?M|| 


1  +  IKIlo 


N 


IB, 


o|o 


=  I^1  -  F2\  , 


which  is  sufficient  for  the  continuity  of  f>  (and  gives  1 0 1 z,ip  =  1).  □ 

To  close  out  this  chapter,  we  consider  two  propositions  under  which  the  quotient  in  (5-1)  is 
bounded  below  and  these  will  lead  to  the  invertibility  of  ([>  and  the  continuity  of  For  the 
first  proposition,  we  essentially  show  cf  is  invertible  if  there  is  a  B  £  B  that  is  invertible. 


Proposition  15  In  addition  to  the  hypotheses  of  this  chapter,  assume  there  exists  causal 
Bl  E  B  such  that  \/y1,y2  E  Y ,  ||Fq  (y^  —  ) 1 1 0  —  m  ll^o  —  2/o  1 1 o ’  w^ere  0  <  m  <  oo  (say  BL  is 
Lipschitz  bounded  below).  Then  |</>|l*p  in  (5-1)  is  bounded  below. 

Proof:  We  have, 


I^F1)-^2)!  =  |Fla  —  F2a[ 


sup  sup 

t  B0eY“ 


la 


-  r,2a)fi0lo 

Iflolo 


>  [(r,1-  -  IBlWl  -  Ffllo 

“  <  I^Io  I  |S0Llo 


> 


sup  -m  ■  sup 

t  UO 


1  +  lluoll? 

}BL[ 


sup 

t 


sup 

Uq 


b^f)-f2)(uq)  ||0 

i  +  WMS 
I^Io 


m-  IF1  -  F2\ 
\BL\ 


(5-2) 


Hence,  {(flup  >  m/\BL\.  □ 

The  next  lemma  describes  an  input-output  system  B  :Y  — >  Z,  which  has  a  specialized 
property.  A  system  is  presented  that  has  norm  one  and,  for  a  specified  input,  has  output 
equal  to  the  norm  of  that  input.  The  system  is  causal,  linear,  and  bounded.  The  construction 
uses  the  Hahn-Banach  theorem.  Specify  a  y*  £  Y  and  z*  £  Z.  In  general  z*  is  an  equivalence 
class  of  time  functions.  Pick  a  time  function  (*,  which  is  an  element  of  z* ,  that  is,  £  [ z *]. 
For  each  t  £  K,  there  exists  a  linear  functional  /*  :  Yj  — >  K  such  that  for  all  t  |/*[  =  1  and 
such  that  ^(yl)  =  \\y*\\t  (see  the  Hahn-Banach  theorem,  [2]).  Define  an  input-output  system 
(Z,B*,Y)  by 

(B-(y))(t)  ±  •  (5-3) 


Note  that  the  output  of  B* ,  as  described  by  (5-3),  is  a  time  function;  however,  the  time 
function,  in  turn,  specifies  an  equivalence  class  of  time  functions  that,  in  general,  is  an 
element  of  Z. 
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Lemma  16  The  input-output,  system  B*  defined  by  (5-3)  is  a  linear  system.  IfY  has  the 
property  that  ||y||t  =  0  implies  ||?/||s  =  0  for  all  y  G  T,  t  and  s  <  t,  (e.g.,  ay-  =  +oo  and 
tCy-  =  1 )  it  is  causal,  and  if  the  “sup”  norm  (Loo)  norm  is  used  on  Z ,  it  is  a  bounded 
input- output  system. 


Proof:  Linearity:  Let  yx,y2  G  Y,  ky,k2  G  K.  Then, 


(B*(k1y1  +  k2y2))(t)  =  f((ki  y1  +  k2y2)t)C{t) 


=  {kyf\y})  +  k2f\y2))C(t)  =  k\B*  (y))(t)  +  k2B*{y2){t)  . 


Therefore, 


B*(hy 1  +  k2y2)  =  kyB*(yl )  +  k2B*(y2)  . 

CAUSALITY:  Take  yl,y2  G  Y  such  that  ||?/  —  y2\\f  =  0.  Let  C1  =  B*(yl)  and  C,2  =  B*(y2).  We 
then  have  that  || y1  —  y2 1|  =  0  for  all  s  <t.  This  implies  (^(s)  =  C2(s)  for  all  s  <  and  by 
property  (1)  of  the  FFs  (see  Definition  1),  H^1]  —  [C2]||f  =  0,  where  the  square  brackets 
indicate  the  element  of  Z  specified  by  the  time  functions;  hence,  B*  is  causal. 

Boundedness:  The  linear  operator  norm  is  used  for  B*. 


sup  1^*1 


=  sup  sup 

t  yo 


Bf(yo)\\0 

IMIo 


=  sup  sup 
yo  t 


II2/0II0 


<  sup 
yo 


supt  |/*(y0)|supt  ||<*(i)|| 

II2/0II0 


supJ/lllyolUIC* 

-  T  \\voWo 


<  sup 

yo 


2/oIIq  IIC 

II2/0II0 


lie* 


Hence,  B*  is  bounded.  □ 

For  the  second  proposition,  we  show  the  quotient  in  (5-1)  is  bounded  below  if  elements  of 
the  form  (5-3)  are  available  in  B. 


Proposition  17  Under  the  conditions  that,  there  exists  causal  bounded  linear  B*  G  B  of  the 
kind  given  by  (5-3)  (including  that,  the  “ sup ”  norm  is  used  in  Z)  then  for  all  F 1,F2,  we  have 
\fi{Fl)  ~  fi(F2)\  >  IF1  -F2!. 

Proof:  Consider 


^(F1)  -  fi(F2)  I  =  []-Fla  -  F2a I  =  sup  sup 

*  B0eY0a 


l(Ftla  -  F2a)B0lo 
D^oDo 


=  sup  sup 
t  Bo6Yna 


\B0(F)  -  F2) i|o  \B*t{F}  -  F2)Io 

o  lip 


\Bo\o  t  11 

\\Bf(F{-F2)(u0)\\0 


B, 


t  ID 


=  sup  ■ 

t 


sup 

ILQ 


1  +  IM 


N 


IB; 


t  llo 


for  any  particular  B*  G  B.  Let  B*  be  of  the  form  given  in  in  Lemma  (16), 

B*(y)(t )  =  ff(yt)  ■  (*(t)  with  |/*[  =  1  and  ||£*(i)||  =  1  for  all  t.  Substitution  in  the  previous 
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equation  gives 


=  sup 

t 


sup 

UO 


|/t((F/-F,2)M)-C(t)|| 


i  +  nii? 


sup 

yo 


>  sup 

t. 


sup 

«o 


n/i-Mc 

llyollo 

Now,  for  all  e  >  0,  3  t  and  v  such  that 


sup 

yo 


=  sup 

t 


sup 

uo 


\MF?  -  Ff){up))\ 
1  + 


II2/0II0 

|f((F/-F2)(u0))| 

1  +  Nil? 


sup 

yo 


fivo) 


Nile 


=  sup  sup 

t  UO 


\MF?  -  F?)(uq))\ 

i  +  Nil? 


IF1  -F2!  <  \F?-F?lo  +  ^  < 


i  +  Nil? 


+  €  . 


Select  (using  the  Hahn-Banach  theorem,  [2])  f1  ( |  fl  |  =  1)  such  that 
f  UF1  -  F2)tv0)  =  || (F1  -  F2)iU0||0,  so  for  this  /, 

|/‘((f.1-f?)Ni))I  ||(F1-FV,||0 

i  +  NII?  1  +  Nil? 

for  all  t.  Then, 


100 F1) 


0(F2)  l+e> 


1  +  NII? 


+  e  >  IF1 


Since  e  is  arbitrary, 

^(F1)  -  0(F2)]  >  [F1  -  F2\.  (5-4) 

□ 

Propositions  15  and  17  give  that  0  is  one  to  one.  Let  F1,  F2  £  F  with  F1  7^  F2,  which  is 
equivalent  to  fF1  —  F2]  >0.  Equation  (5-2)  or  (5-4)  imply  [^(F1)  —  0(F2)|  >  0,  which  means 
0(FX)  7^  0(F2)  so  0  is  one  to  one.  Propositions  15  and  17  also  give  that  0_1  is  uniformly 
continuous.  Consider  the  boundedness  of  0_1.  Let  F  =  F*and  F2  =  0.  Using  these 
propositions,  we  get 

[F]  f  \BL\/m  from  (5  —  2) 

1  + 10(F)!  <  {  1  from  (5  -  4) 

which  are  bounds  for  q U1. 

Both  of  these  propositions  require  that  the  domain  space  B  contain  specific  or  specialized 
elements.  Roughly  speaking,  0  maps  two  different  functions,  F1  and  F2,  to  two  different 
functions,  Fla  and  F2a,  if  the  domain  B  is  sufficiently  large.  In  this  regard,  the  domain  B  may 
be  viewed  as  a  space  of  “test  inputs.” 
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6  ON  THE  INVERTIBILITY  OF  THE  INPUT-OUTPUT  SYSTEM  F  IN 
TERMS  OF  THE  GENERALIZED  ADJOINT  INPUT-OUTPUT  SYSTEM  Fa 


The  results  of  this  chapter  are  divided  in  two  sections.  In  the  first  section,  an  algebraic 
analysis  is  presented.  That  is,  whether  Fa  is  one  to  one  and  onto  when  F  is  and  vice  versa  are 
considered.  In  the  second  section,  a  functional  analysis  is  presented.  Here,  we  define  the 
auxiliary  map  G  G  Q  which,  as  described,  behaves  like  F  and  has  input  space  Ua  and  output 
space  Ya.  The  causality,  boundedness,  and  continuity  of  G  is  considered.  The  extent  that  Fa 
is  the  inverse  of  G  is  considered.  This  covers  the  invertibility  of  F  by  Fa.  Also,  we  consider 
the  boundedness,  continuity,  and  invertibility  of  the  map  from  F  to  Q. 

Invertibility  for  F  and  Fa 


First,  we  assume  that  both  F  and  Fa  are  invertible  and  find  a  relationship  between  the 
inverses.  From  the  definitions 

Fa(B)  =  A  =  BF  .  (6-1) 


However,  since  F  is  invertible, 
hence, 


AF-1  =  B 


{F~1)aA  =  B  . 

Substituting  (6-1)  into  (6-2),  we  obtain 

(F~1)aFa(B)  =  B  . 

Substituting  (6-2)  into  (6-1),  we  obtain 

Fa(F~1)aA  =  A  . 


(6-2) 

(6-3) 

(6-4) 


The  conclusion  from  (6-3)  and  (6-4)  is  that  (F“)_1  =  (F_1)“.  This  is  similar  to  Lemma  7, 
page  479  in  [2],  for  linear  operators  on  Banach  spaces. 

Next  we  consider,  in  the  algebraic  sense,  the  invertibility  of  Fa  based  on  the  invertibility  of 
F.  Meaning,  we  consider  whether  Fa  is  one  to  one  and  onto  if  F  is  one  to  one  and  onto. 
Similar  analysis  for  the  invertibility  of  F  based  on  Fa  is  also  considered. 


Lemma  18  F  onto  implies  Fa  is  one  to  one. 

Proof:  Let  Bi,  B2  G  Ya  such  that  B\  /  B-2 ,  that  is,  B\{y)  /  B2(y)  for  some  y  G  Y.  Pick 
«£[/  such  that  F(u)  =  y.  This  is  possible  since  F  is  assumed  to  be  onto.  Then,  with 
A  =  Fa(Bi),  A  =  Fa(B2), 

A\{u)  =  [Fa(Bi)](u)  =  BrF{u)  =  B^y) 

A2(u)  =  [Fa(B2)](u)  =  B2F(u )  =  B2(y)  . 

Hence,  A±  =/=■  A2  and  Fa  is  one  to  one.  □ 

Lemma  19  F  one  to  one  implies  Fa  is  onto. 
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Proof:  Fix  some  A  £  Ua.  For  this  A,  consider  u  and  z  =  A(u).  For  this  u,  F  specifies  a 
unique  y  £  Y  by  F(u )  =  y  (since  F  is  one  to  one).  Hence,  a  particular  B  is  defined  by 
B(y)  =  z.  Note  that  the  domain  of  this  B  is  not  necessarily  all  of  Y  (it  may  be  a  subset  of 
Y).  In  other  words, 

B(y)  =  A(F^1(y))  V  y  £  Range(F)  . 

This  B  has  the  property  that  Fa(B )  =  A,  so  Fa  is  onto.  □ 

If  F  is  algebraically  invertible,  that  is,  F  is  one  to  one  and  onto,  then  from  Lemma  18  and 
Lemma  19,  we  have  that  Fa  is  also  invertible.  We  consider  the  reverse.  The  following  lemma 
requires  that  A  contains  elements  which  distinguish  elements  of  U,  i.e.,  for  u\  A  u2  there  exists 
A  such  that  A(u\)  A  A(u2).  The  system  described  by  (6-5)  in  the  next  section  fulfills  this. 

Lemma  20  Assume  that  A  contains  distinguishing  A  for  all  u\,u2  £  U ,  such  as  given  by 
(6-5),  then  Fa  onto  implies  F  one  to  one. 

Proof:  Consider  ui,u2  £  U  such  that  u\  A  u2  and  let  A  :  U  — ►  Z  be  such  that 
A(u\)  A  A(u2).  Since  Fa  is  onto,  there  exists  B  £Ya  such  that  Fa(B)  =  A.  Let  y\  =  F(u  1) 
and  y2  =  F{u2). 

[Fa{B)]{u  1)  =  BF(u  1)  =  A(u  1)  =  B{yi) 

[ Fa(B)](u2 )  =  BF(u2 )  =  A(u2)  =  B(y2)  . 

Therefore,  B(y\)  A  T? (2/2) •  However,  this  is  not  possible  for  any  B  unless  y±  A  VA  hence,  F  is 
one  to  one.  □ 

The  following  lemma  requires  that  B  contains  elements  of  the  following  form:  Given 
(Y,  F,  U ),  there  is  a  Bp  £  B  such  that  Bp(y )  =  0  for  all  y  £  Range(F)  and  Bp(y )  =  1  for  all 
y  £  Range (F)c . 

Lemma  21  Assume  B  contains  elements  of  the  form  Bp  mentioned  above  and  that  Fa  is  one 
to  one.  Then,  F  is  onto. 

Proof:  Suppose  F  is  not  onto.  Define  B\  =  Bp  and  B2  =  2  •  Bp.  Since  F  is  not  onto, 

B\  A  B2-  Consider,  A\  =  Fa(B\ )  and  A2  =  Fa(B2).  It  is  seen  that  Ai  =  A2,  indicating  Fa  is 
not  one  to  one;  a  contradiction.  This  is  similar  to  the  last  three  lines  in  the  proof  of  Lemma  7 
on  page  479  in  [2]  for  linear  operators  on  Banach  spaces.  [If  Range(F)c  always  contains  an 
open  set,  allowances  could  be  made  showing  this  result  with  all  B  £  Y°  being  continuous.]  □ 
Lemmas  20  and  21  give  the  reverse  results  to  Lemmas  18  and  19.  The  condition  on  A  in 
Lemma  20  and  on  B  in  Lemma  21  are  a  form  of  completeness  on  the  range  and  domain  of  Fa 
respectively.  Note  that  the  two  completeness  conditions  are  imposed  on  the  adjoint  space. 

On  Fa  as  the  Inverse  of  F 

In  this  section,  the  extent  to  which  Fa  is  the  inverse  of  F  is  considered.  Since  the  domain 
and  range  of  F  are  not  the  same  as,  respectively,  the  range  and  domain  of  Fa,  the  purpose  of 
the  first  section  of  this  chapter  is  to  construct  a  new  system  whose  domain  and  range  are  the 
range  and  domain  of  Fa,  and  that  behaves  like  F.  We  add  the  following  condition  to  those 
indicated  in  Chapter  4: 

5.  The  “sup”-norm  (L^  norm)  is  used  on  Z. 
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A  particular  A  is  constructed  that  has  specialized  properties.  Consider  a  specific  z  £  Z;  z 
is  (in  general)  an  equivalence  class  of  time  functions  and  may  be  denoted  by  [z]  for  emphasis. 
Let  £  £  [z]  be  a  specified  element  in  [z\.  For  each  u #  £  U,  specify  an  A #  £  Ua  by 

A*(u)(t)=  ut  -uf  t-  C(t)  ,  (6-5) 

where  t  £  9ft.  This  system  may  be  defined  using  the  truncated  systems: 

Af(ut)(t)  =  ut-uf  ^  C it)  ;  (6-6) 

Af(u0)(t)  =  u0  -  (^t«#)0  Q  •  C(t)  .  (6-7) 

Obviously  A #  is  not  linear.  The  set  of  all  such  A #  is  A #  C  A.  We  see  that  the  map 
7  :  U  — >  A ^  defined  by  7 (u#)  =  A #  is  one  to  one  and  onto,  provided  £(f)  A  0.  In  fact,  7  is 
onto  by  construction.  To  see  that  it  is  one  to  one,  consider  u#  A  A  ■  IR  this  case,  there  exists 
t  such  that  uf  A  uf  Hence,  Af  ( uf)(t )  =  uf  -  uf  ^  ( (t)  A  uf  -  u\  ^  ■  ((t)  =  A\(uf)(t). 
So  A #  A  A9 ,  and  7  is  one  to  one. 

The  causality,  boundedness,  and  continuity  of  A &  is  considered  in  the  next  lemma. 

Lemma  22  A #  of  the  form  given  by  (6-5)  is  causal,  bounded,  and  uniformly  compatibly 
continuous  (see  Definition  7). 


Proof: 

Continuity  AND  Causality:  Consider  the  Lipschitz  norm  of  A #:  Let  M  =  sup t  ||C(t)||, 
„  A  ~n  Af(u])-Af{u2) 

l  A*  l  Lip  =  SUp[Af  \Lipit  =  sup  sup  - 71— i - oTT - 

t  t  Ul,U2  \\Ut  -  ||^ 

u\-uf  -  u2t-uf  .||C(t)||  II u]-u2t 

=  sup  - — Ti  - 7yr, - - -  <  sup  tt—. - ^ 

t,U  !,U2  ||  Ut  -  uf  ||t  t,U  1,U2  ||  uf  -  uf 

The  above,  by  Definitions  4  and  7,  shows  that  A &  is  causal  and  uniformly  compatibly 
continuous. 

Boundedness:  It  is  shown  that  A#  is  bounded.  Refer  to  (2-5)  and  (2-8): 


-  ■  M  =  M  . 

t 


IA#1  =suPIAflt  =  sup 

t  t,U 


1  + 


uN 

III 


Ut  —  Ut 

<sup- - 1 — T\r  •  sup  ||C(*)II  <  (1  +  sup  uf  ) -sup||C(t)|| 

t,u  1  +  \\Ut\\t  t  t  t  t 

=  (1  +  sup  uf  )  •  M  =  (1  +  vA  )  •  M  ,  (6-8) 

t  t 

for  any  N  >  1.  □ 

In  the  following  paragraphs,  some  properties  of  A ^  are  considered. 
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Lemma  23  If  (  is  a  constant,  i.e.,  f(t)  =  f  for  all  t,  A #  is  translation  invariant. 

Proof:  As  discussed  in  the  introductory  paragraph  of  Chapter  3,  the  left  translate  by  r  of 
A #  is  L*A &  =  LtA#Rt.  Given  u#,u,  we  have, 

L*A*(u)(t)  =  ( LTA*RT)(u)(t )  =  LT{A*(RTu)(t )) 

=  Lt{  (Rru)t  —  uf  ^  ■  C(t))  =  Lr{  ut-T-uf 

=  Lr(  ut-r  -  uf  f)  •  Lr((t)  =  ut  -  uf+T  ^  C(t  +  t)  .  (6-9) 

Let  ill  =  LpuA1 .  Since  U  (the  input  space  to  F)  is  translation  invariant  ub  €  U.  We  have 

L*A*  =  Ab  e  A* 

where  Ab  =  7(ub).  □ 


We  consider  the  effect  of  a  translation  in  U.  As  in  the  proof  of  Lemma  23,  let  ub  =  Lru&, 
then 


A\u)(t)  =  ut  -  u\  ^  ■  t(t) 

=  ut  -  {LTu*)t  ■  C{t)  =  ut  -  u*t+T  -C(t)  . 

(6-10) 

Using  (6-9)  we  get 

u*  2+  a#  ( L*A *)  . 

(6-11) 

Using  (6-10)  we  get 

u*  h  Lru*  =  ub  -4  Ab  . 

(6-12) 

Since  (6-9)  does  not  equal  (6-10),  in  general,  equations  (6-11)  and  (6-12)  cannot  be  used  to 
form  a  commutative  diagram,  i.e.,  7  does  not  preserve  translation.  However,  if  f  =  (  a 
constant,  then  (6-11)  and  (6-12)  do  form  a  commutative  diagram.  Since  the  sup  norm  is  used 
in  Z,  selecting  (  a  constant  is  valid.  We  will  designate  A #  as  an  input  space  and  by  Condition 
4  listed  above,  it  has  to  be  translation  invariant.  Setting  f  as  a  constant  fulfills  Condition  4; 
however,  we  will  not  assume  this,  which  gives  the  subsequent  presentation  a  little  more 
generality. 

Remark  24  A #  is  not  closed  with  respect  to  addition,  in  general.  In  fact,  for  u# ,  uf  £  U 
and  A#,  Ab  e  A#, 

(A*  +  A^)u(t)  =  A#u(t)  +  A^u(t) 

=  [  ut-uf  t+  ut-u\  y c(t) . 

The  above  is  a  causal  input-output  system  from  U  to  Z;  however,  it  is  not  likely  in  A*. 

Hence,  A &  is  not  shown  to  be  closed  with  respect  to  addition. 

Further  properties  of  7  are  considered.  We  observe  that  7  is  not,  in  general,  linear.  The 
next  two  lemmas  examine  the  boundedness  and  continuity  of  7  and  7_1. 

Lemma  25  Let  sup(  ||£(f)||  =  M  <  00.  Then  map  7  :  U  — >  A #  is  bounded  and  uniformly 
continuous. 
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Proof:  Boundedness  of  7:  Lemma  22  gives  that 


a  ||7(^#)||  I^4#I 

=  SUP  7 . . By  =  SUP 


<  sup 

u# 


#  1  +  ||u#||  U*  1  +  ||tt#|| 

(1+  ||«#||)  -SUPt  ||C(t)|| 


N 


1  +  ||u#|| 


N 


<2  ■  M  . 


Hence,  7  is  bounded. 
Continuity  of  7: 


\l{u*)  -  7(«b)l  =  \A*  -  Hbl  =  sup []Hf  -  A% 


=  sup 

t,u 


Af{ut)  -  A\(ut) 


1  + 


N 


=  sup 

t,u 


Ut  ~  U'i 


# 


C(t)  -  || ut  -  u\ ||  •  C(t) 


1  +  ll^tll 


N 


<  sup 

t 


ut  —  it 


H  ~  ut 

Hence,  7  is  uniformly  continuous.  □ 


•sup||C(t)||  = 

*  t 


U #  —  V? 


M  . 


Lemma  26  Let  supf  \\((t)\\  =  M  <00  and  inf*  ||£(t)||  =  m  >  0.  Then  the  map  7  1 
is  bounded  and  continuous. 


Proof:  Continuity  of  7 


-1. 


|7 (u*)  ~  7(«b)I  =  \A*  -  #1  =  supIHf  -  4 \t 

t 


>  sup 

t 


u\  -  uf 


C (t)  -  u\-u\  ■  C (t) 


„  b  N 

1  +  IKIlt 


u\  -  uf 

-  >  sun 

t  1  +  IKiu 


N 


•  inf  ||C(^) 


> 


sup 


u\  -  uf 


t  l  +  Wut\\t 


N 


r  ■  m> 


it  —  u # 


m 


1  +  ub 


1 N  ■ 


Using  this  and  (6-8),  we  have 


m 


<  [7(0)  -  7(ub)l  <  17(0)1  +  17^)1  <  M  +  l7(ub)I 


Hence,  from  (6-14), 


ub  —  u # 


b  N 

<  — - - h(u#)  -7(«b) 


m 


1  + 


< 


N 


m 


m 


(u*)-  7(ub)l  . 


(6-13) 

:  A* 

(6-14) 

(6-15) 
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Hence,  7  1  is  continuous.  Note  that  (6-14)  also  gives  that 


\A*-A%>  u\  -  uf 


m 


1  1  +  ub 


1  TV  ’ 


which  will  be  needed  below. 

Boundedness  of  7-1:  From  (6-15), 


u#)fl  +  M  > 


u 


# 


•  m  . 


Or 

M  •  (l7(n#)l  +  1)  > 
where  M  =  max(M,  1).  Therefore, 


u 


# 


m 


(6-16) 


|u#||  M 
1  +  l7(n#)I  “  m 


(6-17) 


which  gives  [7  1[  <  M/m.  This  is  the  norm  [7  1 1 (1) ;  however,  as  stated  in  the  appendix  of 

[9],  if  M<N,  l7-1I(iV)<2-l7”1I(M)-  □ 

In  the  next  lemma,  we  consider  whether  7  is  a  monotonic  function,  i.e. ,  if  ||ii1^t||  <  ||u2#|| 
then  ||7(u1#)||  <  ||7(u2^)||.  Since  orthogonality  is  needed  in  the  proof,  in  this  lemma  we  use  a 
weighted  L2  norm  on  U . 

The  weighted  L,2(s,t)  space  (2-1),  —00  <  s  <  t  <  00,  with  p  =  2,  is  a  Hilbert  space  with 
inner  product 

rt  \  1/2 

(6-18) 


(u,v)Sit=  (^  u{T)v{r)w{t  -  T)dT 


when  w(t)  >  0  for  all  t.  In  Lemma  27,  we  assume  the  input  space  U  is  a  Hilbert  space  with 
inner  product  (6-18). 


Lemma  27  If  ((t)  /  0  for  all  t  and  the  weighted  L2  norm  derived  from  the  inner  product 
(6-18)  is  used  on  U  with  w(t )  >  0  for  all  t,  then  7  is  monotonic. 


Proof:  Given  vfr,  u\  let  ||«#||0  <  ||'«t’||0-  Define  a  hyperplane  H  by 
H  =  {u  £  U\  || it  —  «#||0  =  ||n  —  ■u^Iq}.  H  divides  Uq  into  two  regions.  Region  Uq  contains  uf 
and  region  Uq  contains  uf  With  this  construction,  uo  €  uf  iff  \\u  —  u#||0  <  ||it  —  itb ||0  and 
uq  G  Uq  iff  1 1 u  ~  1 1 0  >  ||  u  —  ub||0.  Thus,  Oq  G  Uf.  Consider  the  following  quotients: 


I  u  —  u #  I 


1  +  llu 


\N 


and 


u  —  u^ 
1  +  Hull 


llo 

N  ' 

0 


(6-19) 


j± 

For  u  0  £  Uq,  the  numerator  of  the  right  quotient  is  larger  than  the  numerator  of  the  left 
quotient.  Consider  uo  £  Uq.  Construct  a  perpendicular  P  from  uq  to  H.  Denote  the  point  in 

_i± 

Uq  along  P  equidistant  to  H  as  rio  is  by  uq.  Consider  the  quotients: 


I  u  —  u*  |  L  1 1  u  —  v?  I L 
1  110  and  11  110 


1  +  ||u 


I N 

lo 


1  + 


I  — 11  AT 

Mlo 


(6-20) 
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We  have  that  ||w||0  <  ||u||0  and  that  ||n  —  u#\\Q  =  ||u  —  ^Hq-  Hence,  the  right  quotient  is 
larger  than  the  left  quotient.  Hence,  from  (6-19)  and  (6-20) 


sup 

U 


u  —  u# 

1  +  llull 


jlo 

N 

0 


<  sup 

U 


u  — 

i  +  Hull 


MO 

N  ■ 

0 


Therefore,  if  A #  =  7 (u#)  and  Al  =  ry(v!>)  such  that  it#  <  u ^  ,  then 


IH#l  =  supIAflt 

t 


sup 

t,u 


4k 

Ut  -  Ut 


IICWII 


1  + 


nN 

lit 


<  sup 

t,u 


ut  -  u\ nt  •  warn 


1  + 


II JV 

lit 


<supl4lt  =  IHbI 

t 


and  7  is  monotonic.  □ 

The  input  and  output  spaces  U  and  Y  of  F  are  not  the  same  as  the  input  and  output 
spaces  Ya  and  Ua  of  Fa.  With  this  feature,  Fa  could  not  be  the  inverse  of  F.  As  stated  in  the 
first  paragraph  in  this  section  of  the  chapter,  an  auxiliary  system  having  the  same  input  and 
output  spaces  as  the  output  and  input  spaces  of  Fa  and  having  similar  behavior  to  F  is 
needed.  To  define  the  auxiliary  system,  each  £  U  is  assigned  to  an  A#  £  Ua.  Select  a  time 
function  (  £  [z]  £  Z,  with  ((t)  /  0,  and  define  an  A#  :  U  — >•  Z  by  (6-5).  Also,  for  y  £ 
Range(F),  define  a  B #  :Y—*Z  by 


yt  -  vi 


# 


C  (t) 


The  auxiliary  map  G  of  F  has  domain  {A^}  =  A #  C  A  (see  6-5)  and  is  defined  by 


G{A*){y){t)  k 


yt  —  Ft{uf)  -C  (t) 


(6-21) 


The  map  G  is  related  to  F  in  the  following  sense.  If  y #  =  F(u #)  and  A &  £  A #  and  B #  £  B & 
are  derived  from  u &  and  y #  respectively  as  described  above,  then  G(A^)  =  B& .  Note  that 
with  domain  A ^  C  A,  G  has  range  B&  c  B.  Also  note  that  (6-21)  defines  a  unique  G 
for  each  F. 

Next,  we  consider  whether  Fa  inverts  G.  For  this,  assume  that  F  is  one  to  one.  Let 
ytt  =  F(u#)  so  that  B #  =  G(A&).  We  have 


Fa(B*)u(t)  =  ( B*F)u{t )  =  B#(Fu){t) 


(F  (u) 


(F(«)-F(«#))t|  -C(i) 


(6-22) 


jj 

Denote  the  set  of  input-output  systems  FaB  of  the  form  (6-22)  by  Ap.  Define  an  equivalence 
relation  for  systems  in  A #  and  A ^  based  on  null  spaces,  i.e.,  two  systems  are  equivalent 
if  their  null  spaces  are  exactly  the  same.  Since  F  is  assumed  to  be  one  to  one,  using  this 
equivalence  relation  on  the  right  hand  side  of  (6-22)  we  have 


r\^ 


•  m  =  (A*Mt) . 


(6-23) 
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The  systems  given  by  (6-22)  and  (6-23)  are  the  only  two  elements  in  their  equivalence  class. 
Hence,  from  (6-21)  and  (6-23), 

Fa(G{A*))  ~  A*  ,4  (6-24) 

The  next  lemma  considers  elementary  properties  of  the  map  G. 


Lemma  28  The  operator  G  is  memoryless.  If  supt  ||£(i)||  =  M  <  oo  and  inf)  ||£(t)||  =  m  >  0, 
G  is  bounded.  If,  in  addition,  F  is  compatibly  continuous,  then  G  is  compatibly  continuous. 


Proof:  Memoryless:  Consider  A#,  Af  such  that  \A#  —  Af  =  0  for  all  s,t  £  -ft.  This 
gives  that  for  all  u  €U,  ||H^(«)  —  ^(it)]!  =  0.  From  (6-5)  (and  since  the  “sup”  norm  is 

used  on  Z), 


uT 


C  (t) 


•  C(t)  =  0 


(6-25) 


for  all  s  <  t  <  t.  Substituting  u  =  u#  in  (6-25)  gives 


'  C(r)  =  0  for  all  s  <  r  <  t  . 


(6-26) 


Now,  for  any  y  &Y  we  have 

\{G(A#)-G(A’))(y)(T) 


y  -  F(u# )  ■  C(t)  -  y  -  F(uB)  ■  C(r) 


< 


F(vf)-F(v*)  .||C(r)||=0, 

T 

for  all  s  <  t  <  t,  from  (6-26)  and  the  causality  of  F.  The  above  implies 

lG(A#)-G(A%,t  =  0  , 


which  indicates  that  G  is  memoryless.  Therefore,  one  memoryless  system  inverts  another 
memory  less  system.  One  consideration  is  how  a  linear  map,  Fa,  could  be  the  inverse  of  a 
nonlinear  map,  G.  However,  note  the  input  space  of  G  is  not  a  linear  space.  In  fact,  it  is  not 
closed  with  respect  to  addition  (see  Remark  24). 

Boundedness:  Under  the  stated  condition,  it  is  shown  that  G  is  bounded. 


nru  A  ^  n  1  Gt(A#)\ 

|G|  =  sup | It  =  sup  sup  - 

*  *  A#&A#  1  + 


N 

t  U  t 


=  sup  sup 


Gt(Af)(yt 


a*&a*  t>y  (1  +  1 1 2/t  1 1 1 )  ( 1  + 


N\ 
t  U  > 


< 


sup  sup 

A#eA#  t^v 


yt  -  Ft(  uf) 


(1  +  Itel.Ki  +  \Af  If) 


•sup||C(t)|| 


4An  alternative  to  (6-5)  and  (6-21)  are  A*{u){t)  =  5{ut  —  uf)  ■  ( (t)  and  G{A*){y){t)  =  5(yt  —  Ft(uf))  ■  £(t) 
where  <5  :  Ut  — >  5R  is  the  delta  function,  that  is  5(ut)  =  1  if  ut  is  zero  and  =  0  else.  This  A #  is  bounded,  but  not 
continuous;  however,  the  equivalence  relation  in  the  invertibility  calculation  becomes  an  equality. 
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yt\\t  + 


<  sup  sup 


Ft(uf) 


■  sup 


a#&a#  Lv  (1  +  1 1 2/t  1 1 1 )  ( 1  +  l-A-f  1^)  t 

I  Ft(uf) 


<  1  +  sup  sup 


A#&A*  *  (1  + 


•  M. 


(6-27) 


H  U 


_LL 

A  lower  bound  for  [A^  [t  is  needed.  Consider 


Af(ut) 


t  U  =  sup 


supr<t 


AT  =  sup  ■ 

i  +  IMlf  « 


UT  ~  U 


# 


IIC(r)|| 


1  +  ll^illT 


>  sup 


4k 

Ut  -  ul 


1  + 


N 


inf  IICWII  > 


T<t 


m 


(6-28) 


Substituting  into  (6-27)  and  using  p.  =  min(l,  rn)  gives 

|  Ft(ut) 

IGI  <  |  1  + sup  sup 

t  ueu  (1  + 

(  \  M  M 

=  (  1+SUP|JI|  )._  =  (!  +  |1T|)  .  . 

V  t  )  M  I-1 

Continuity:  Finally,  we  show  that  G  is  compatibly  continuous  under  the  stated 
conditions. 

\\Gt(Af)(yt)-Gt(A\)(yt)\ 

IG(A*)-G(A%  =  sup 
y 


(6-29) 


<  sup 
y 


yt  -  Ft{uf ) 


1  +  \\yt\\t 

yt  -  Ft{u\)  ' 


N 


N 


<  sup 

y 


i  +  Wvtwt 

Ft{ut)~Ft{u\)  || 

-  ■  M  < 


•sup||C(t)|| 


i  +  nrf 


Ft(u*)  -  F,K) 


•  M  . 


Since  F  is  compatibly  continuous,  given  v) 7  for  all  e  >  0,  there  exists  5  >  0  such  that  if 


ut  —  u* 


<  5  then 


Ft(uf )  —  Ft(u\)  <  e,  for  all  t.  Hence,  using  (6-16),  G  is  compatibly 


continuous.  □ 

We  consider  the  boundedness  and  continuity  of  the  map  p  :  F  — >  Q  ( p(F )  =  G). 

Lemma  29  Let  supf  ||£(f)||  =  M  <  oo  and  inf*  ||£(t)||  =m>  0.  Then  map  p  :  T  — ►  Q  is 
bounded  and  continuous. 


Proof:  Boundedness:  Consider 


IpI  =  sup 
F 


n^n 

l  +  I  F\' 
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However,  this  is  just  given  by  (6-29)  that  is, 


< 


M 


(m) 


N 


(6-30) 


where  /i  =  min(l,m). 

Continuity:  Let  p  (F1)  =  G 1  and  p  (F2)  =  G2.  Consider 


Hz'  a#\ 

JTf 

t,A 

Si(AfXm)  -  G?(Af)W 


IG‘  -0*1=  suplo;  -  Gf  I,  =  sup  |G‘1(f+)|I*|l'4f)l‘ 


<  sup 
t,A,y 


3  (1  +  toll,)  •  (1  +  Mf If' 

t~  yt-Ff(uf ) 

(i  +  llrt)-(i  +  lW) 

Fl{uf)  -  F2(uf) 

<  sup 
t,A 


sup  \\C(t)\\ 
t 


(i  +  mf) 


M 


<  sup 

t,U 


Fl(ut)  -  F2{ut) 


if) 


‘  IF1 


(1  +  ll^tllt 

using  (6-28)  □. 

We  consider  the  boundedness  and  continuity  of  the  map  p-1  :  Q  — >  F  (p_1(G)  =  F). 


Lemma  30  Let  supf  \\((t)\\  =  M  <  oo  and  inf t  ||£(f)||  =  m  >  0.  Then  map  p  1  :  Q 
bounded.  With  the  coarser  C^-n)  topology  on  Q ,  p is  continuous. 


T  is 


Proof:  Boundedness:  Consider 


1*1 


sup 

t,U 


Ftiut )  t 

i  +  IMlf 


sup 

t,U 


Ftiut )  t 

1  +  I^If 


i+M 

i  +  iwif 


where  A  =  'fin), 


<  sup  • 


yt  -  Ftiut ) 


t,u,y  (1  +  \\yt\\t)  •  (1  +  )  •  m 


I  +  Mllf 

sup - JTf 

1  +  IKIlt 


Gt(At)(zft)  t 

t,u,y  (1  +  llytlli)  •  (1  +  I^-tlf )  •  ni 
lGtjAt)\t  1  + 

M'(l  +  M,If)'m'S,Tl  +  |K||f  " 


1  +  1.4, If 

•  sup  - w 

t,u  1  +  |K||t 

M .  SUD  i+W 

m  hu  i  +  Kllf 


(6-31) 
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However,  using  (6-8)  we  get 


\N 


i  +  IMt  <  i  +  ((i  +  IkU  •  jk  _ 
l  +  IMif-  i  +  "-l|JV 


Using  this  in  (6-31)  we  obtain 


ik1  (go  i  =  m  <  -  •  igi 


and  this  gives  that  p  1  is  bounded. 

Continuity:  Let  p~l  (G1)  =  F1  and  p~l  (G2)  =  F 2.  Consider 


nc1  c2i  ^JG'K^-g2^)! 

Ilk  -  Gt  ||t  -  sup - rrmnv — 

yt-F?(ut) 


a  1  +  I  At\^ 


=  sup  ■ 

A,y 


yt  -  k2k)  ||t)  •  C  (t) 


(1  +  lkU  -(1  +  K1 


N\ 


Letting  yt  =  Ff(ut)  in  the  above  equation  gives  for  all  A,  u 

I FKut)  ~  Fl{ut) 


> 


(1+  Flint)  )•(!  +  iHtlf) 


There  are  two  cases  to  consider  in  (6-34). 


Case  1: 


F2(«t)  <  1.  This  gives  that  in  (6-34) 


> 


FHnt)  -  Flint) 


■  m 


(i  +  lkll 


(i  +  lkll 


> 


2  •  (1  +  [At[: 

Flint)  -  Fl{ut) 


> 


Flint)  -  Flint) 


~  (1  +  W 

m  1 


AL 


m 
2 ~c 


(1  +  W 


2 -N\ 


2  •  c  2 


where  c  is  the  constant  in  (6-32). 


Case  2: 


> 


F2(«t)  >  1.  This  gives  that  in  (6-34) 


Flint)  -  Flint) 

•  m 
t 

Flint) -Flint) 

2  • 

to 

t-(i  +  Iklf) "  (i  +  lkllf)2 

t  m-  (!  +  Ikllf) 
t-2-(l  +  DkIf) 


> 


Flint)  -  Flint) 


(i  +  lkll 


2-N\ 


c 


\Fllt 


(6-32) 


(6-33) 


(6-34) 


(6-35) 


(6-36) 
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(using  (6-32))  where  C  is  a  constant.  Combining  (6-35)  and  (6-36),  we  get  that 


I G? 


>  \Ft2 


Ftl(2-N)t  '  min( 


1 


2  •  c  •  2 


Hence, 

K  ■  max(l,  •  \ G2  -  >  \Ft2  -  Ft%.N)t  , 

for  some  0  <  K  <  oo.  Using  (6-33)  we  obtain 

K'  •  max(l,  lG2t\t)  ■  \G2t  -  Gjl(N)t  >  \F2  -  Ft%.N)t  ,  (6-37) 

For  some  0  <  K'  <  oo.  Equation  (6-37)  gives  that  p_1  is  continuous,  with  the  C jy  topology  in 
Q  and  the  coarser  C^-n)  topology  in  T .  From  Lemma  A. 4  in  Appendix  A  of  [10],  if  F  G  C/v 
then  F  G  C^-N)-  ^ 

Denote  a  functional  form  of  the  equivalence  operator  given  in  (6-23)  by  D.  That  is, 


D(  F(u)-F(u*) 


m  = 


u  —  u 


# 


c(t) 


We  consider  the  boundedness  and  continuity  of  this  operator  and  its  inverse. 

Lemma  31  Let  F( 0)  =  0  and  F ~1  be  bounded  and  continuous.  Let  B #  =  G(A^)  and 
A #  =  Fa(B#)  as  in  (6-23).  Then  D(Fa(B#))  =  A #  so  defined  is  bounded  and  continuous. 

Proof:  Boundedness:  Consider 


PI  =  sup 


supti„ 


Ut  -  Ut 


# 


B#  1  +  li^B#)p-SsT 

IICWII 


1  +  ll^illT 


sup,, 


1  +  \Fa(B#)lN 


jt 

Ut  -  ufi 


<  sup 
t,B# 


i  +  Kiii 


N 


1  +  1  F?{B#)\? 


<  M  +  sup 


u 


# 


■  M 


t,u#l  +  (m-  Ft(uf) ||) 


\N 


<  OO 


since  F  1  is  bounded  and,  referring  to  (6-22),  we  have 


(6-38) 


\Fta(B*)\t  >  sup 

Ut 


Ft(ut)  -  Ft(u 


1  +  ||  Ut 


\N 

\t 


m  > 


Ft(uf) 


m 


with  F(0)  =  0. 

Continuity:  Let  D(Fa(B #))  =  A #  and  D(Fa(B^))  =  A.  Recalling  (6-13), 


\A*  -  Al\  < 


■  M  . 


(6-39) 


Now, 


1  Ff(B*)-F?(Bl)\t> 


Ft(uf) 

-Ft{u\) 

t 

1  + 

4 

N 

t 

■  m  , 
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Ft{u*)  -  Ft(u\)  '  <  (- 


1+  uf 


<  (1  +  (a^/m)JV)  •  I Ff(Bt)  ~  F?{B\) \t 
from  (6-28).  Taking  the  supremum  over  t  on  both  sides  gives 


F(u*)  -  F(i/)  <  ( 


1  +  (B A*\/m)N  ^  _  | F'a(B#)  -  Fa(B9) 


(6-40) 


We  see  from  (6-38)  that  for  some  C 


1  +  \Fa(B#)\N 


<  C  <  oo  . 


Therefore, 


Substituting  into  (6-40)  gives 


1^4#1  <  C-  (l  +  !Fa(S#)lJ 


F(u*)-F(uf  <  ^  +  ^  '  (1  +  lFa{B*)\N) /m)N )  ,  j^^#)  _  Fa{B°)\  .  (6-41) 

m 

Using  (6-39),  (6-41)  and  the  continuity  of  F  ,  we  conclude  that  D  is  continuous.  □ 

Lemma  32  Let  B*  =  G(A*)  and  A *  =  Fa(B*)  as  in  (6-23).  Then  D~1(A^:)  =  Fa(B*)  so 
defined  is  bounded  and  continuous. 

Proof:  Boundedness:  Consider 


„n-i„  \Fa(B#)\  ^  \Ft(B*)lt  ^ 

lD  =  sup  i  i  Oi#oiV  ^  sup  I TTjuF  -  sup 

A#  l  +  iA#l  t,A*l  +  \Af\f  t,A# 


suPr<t  Ft{ut)  -  Fr(uf)  ^  •  ||C(r) 

_ 1  +  \\ut\\f _ 

1  +  (m  ■  uf  )N 


where  we  use  (6-22)  and  (6-28), 

Ft(nf) 

<  M  •  (1F|  +  sup - -f - )  <  oo  . 

t,u#  1  +  (m  ■  uf  )N 

1  t 

Continuity:  Let  D~l(A#)  =  Fa{B*)  and  D~1(Ai>)  =  Fa(Bl>).  Consider 

\Fa(B*)  -  Fa(Bf  I  =  suplF“(Bf )  -  Fta(B\)\t 

t 


<  sup 

t.U 


Ft(ut)  -  Ft(uf)  -  Ft(ut)  -  Ft{u\)  -M 

1  +  Ikllf 
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<  sup 

t,U 

However,  using  Lemma  26 


Ft{uf)  -  Ft(u\) 


1  + 


N 


M  < 


F{u*)  -  F(nb) 


u &  — 


<  1  70#)  ~7(«b)I 


1+ 

\  m  J 


M  . 


N 


(6-42) 


m 


therefore,  using  this,  the  continuity  of  F  and  (6-42),  D  1  is  continuous.  □ 

Summary 


In  this  chapter  we  analyzed  the  generalized  adjoint  system.  The  main  theme  is  invertibility. 
Initially,  we  found  that  Fa  is  one  to  one  when  F  is  onto  and  Fa  is  onto  when  F  is  one  to  one. 
With  some  conditions,  F  is  one  to  one  when  Fa  is  onto  and  F  is  onto  when  Fa  is  one  to  one. 

The  analysis  continues  from  the  functional  viewpoint.  The  lower  portion  of  Figure  2 
depicts  the  situation.  Four  equations  give  the  essentials:  Equations  (6-5),  (6-21),  (6-22),  and 
(6-23).  Starting  with  u  £  U ,  following  Figure  2,  the  operator  7  maps  U  onto  U# .  A #  =  7  ( u ) 
is  an  input-output  system  form  of  the  input  u.  This  is  Equation  (6-5).  The  operator  p  maps 
F  to  G.  Equation  (6-21)  gives  the  auxiliary  map  to  compute  G  (^4^)  =  B #  £  Ya.  At  the  top 
of  Figure  2,  the  generalized  adjoint  gives  Fa  ( B #)  =  B^F  £  Ua.  This  is  Equation  (6-22). 
Finally,  the  equivalence  operator,  Equation  (6-23),  gives  B^F  ~  .  The  remainder,  and 

bulk  of  this  chapter,  is  an  analysis  that  provides  boundedness  and  continuity  conditions  for 
the  systems  and  transformations. 

The  upper  portion  of  Figure  2  shows  the  situation  depicted  in  Figure  1. 
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Figure  2:  Functional  Diagram 
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7  NOISE  AND  DISTURBANCE  BOUNDS  USING  ADJOINTS 


We  consider  the  generalized  adjoint  in  computing  bounds  for  noise  and  disturbance  inputs. 
The  method  of  adjoints  has  been  discussed  for  traditional  input-output  systems;  for  example, 
in  Laning  and  Battin  [4],  Zarchan  [14]  gives  a  discussion  of  adjoints  in  connection  with  noise, 
disturbances,  and  other  error  sources  in  the  homing  loop  of  a  missile  autopilot.  As  discussed 
in  these  two  references,  the  adjoint  facilitates  the  calculation  of  noise  and  disturbance  budgets 
and  this  will  be  reproduced,  to  some  extent,  in  the  context  of  generalized  adjoints.  Let  the 
input  be  represented  by 

U=(ui,U2)  (7-1) 

where  the  first  component  U{  of  u  nominally  represents  the  noise  inputs  and  the  second 
component  U2  nominally  represents  the  disturbance  inputs.  The  transfer  function  between 
noise  input  and  the  output  and  the  disturbance  input  and  the  output  are  assumed  to  be 
different  -  which  is  usually  the  case.  Toward  the  fulfillment  of  the  hypotheses  of  Lemmas  23 
through  30,  we  assume  (  is  a  constant  (  in  this  chapter.  We  will  need  that  7  be  nronotonic. 
Lemma  27  gives  this  if  the  input  space  (7-1)  is  a  Hilbert  space.  The  inner  product  for  the 
compound  input  may  given  by 

(u,v)  =  ((ui,u2),  (vi,v2)}  =  (ui,u2)  +  {vi,v2)  •  (7-2) 

With  the  tapered  L2  norm  used  on  u\  and  u2 ;  and  the  inner  product  (7-2),  the  input  space 
(7-1)  is  a  Hilbert  space.  We  represent  the  system  in  compound  form  as  follows: 

y  =  F(u)  =  F(ui,u2 )  .  (7-3) 

In  this  chapter,  the  Cn  topology  is  used  for  F,  although  in  the  case  of  noise  and 
disturbance  inputs  it  may  be  more  reasonable  to  use  the  sup-norm  topology  of  bounded 
spaces,  Co-  Assume  that  the  output  response  due  to  noise  and  disturbance  inputs  for  an 
acceptable  design  is  fixed  and  bounded.  The  objective  is  to  determine  maximum  allowable 
noise  and  disturbance,  i.e.,  determine  a  noise  budget  and  a  disturbance  budget.  Once  these 
budgets  have  been  determined,  measures  are  taken  so  that  excessive  noise  and  disturbance  do 
not  enter  the  system.  These  measures  may  include  filtering,  design,  and  components. 
Typically  the  noise  and  disturbances  enter  the  system  independently.  Therefore,  the  noise 
budget  and  disturbance  budget  are  computed  such  that  for  any  noise  within  the  noise  budget, 
together  with  any  disturbance  within  the  disturbance  budget,  the  output  response  due  to 
noise  and  disturbance  is  acceptable.  We  assume  that  the  system  is  nronotonic  in  the  noise  and 
disturbance,  i.e.,  greater  input  noise/disturbance  results  in  greater  output  noise/disturbance. 
Specifically,  F  nronotonic  in  noise  and  disturbance  means  that  given  (ui,u2)  and  (uj,  u'2)  such 
that  ||('ui,'u2)||  <  ||«,u'2)||  implies  ||F(ui,  u2)||  <  ||-FKX2)||. 

Using  the  standard  method  (not  using  adjoints),  various  u\  and  u2  are  fed  into  (7-3), 
together  and  separately,  since  F  is  nonlinear.  By  observing  y,  budgets  for  u\  and  u2  would  be 
determined.  With  adjoints,  the  budgets  are  simultaneously  determined. 

Consider  the  bound  on  the  output  due  to  the  noise  and  disturbances.  We  need  the  output 
||y||  =  ||F(n)||  <  C,  where  C  is  this  bound.  Define  a  subset  of  B, 

Be  =  {B\B  =  7 (y),  ||y||  =  C}.  Since  we  have  that  7  is  nronotonic  function,  we  only  need 
B  e  Be  to  correspond  to  y's  at  the  noise  and  disturbance  bound,  which  is  the  edge  of  the 
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shape  in  the  transformed  space.  Define  Ac  C  A  =  {A\A  =  Fa(B),  B  £  Be}-  Going  back  to 
the  input  space,  define  U  D  Uc  =  7_1(.4c)-  Now  compute 

u\ max  =  nrax  \\ui\\  such  that  (u\,U2)  =  u  £  Uc  ■ 

Similarly,  define  112  max-  These  are  the  noise  and  disturbance  bounds.  This  is  analogous  to 
portions  of  the  situations  presented  in  [4]  and  [14]. 

In  summary,  the  noise  and  disturbance  effects  at  the  output  are  design  to  quantities. 

Using  the  upper  and  left  sides  of  Figure  2,  U  is  determined.  The  monotonicities  of  the  system 
and  the  transformation  7  are  essential.  The  input  end  has  the  same  monotonicity  but  does 
not  have  the  previously  mentioned  edge  to  work  with.  Two  cases  may  be  addressed  with 
regard  to  the  system  input.  First,  the  case  where  the  design  is  around  a  fixed  input,  or 
equivalently,  an  autonomous  system.  Second,  take  the  input  and  disturbance  together.  The 
input  u  is  normally  modeled  to  enter  the  system  at  the  same  location  as  the  disturbance  d. 
This  model  would  have  112  =  u  +  d.  In  this  case,  the  disturbance  bound  discussed  would  be 
parcelled  out  between  the  input  and  the  actual  disturbance. 
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8  EXAMPLE 


In  this  chapter,  an  illustrative  example  is  presented.  An  integral  operator  representation 
will  be  used  for  the  system  mapping  discussed  in  Chapter  2.  A  few  of  the  constructions  of  this 
report  are  illustrated  with  this  example.  Let  Ft  =  {(Yo,  Et,  E/o)},  a  space  of  causal 
input-output  systems,  be  given  by  a  second  degree  integral  operator.  The  system  equation  is 

roo  poo 

Ft{uo){a)  =  /  /  f(t  +  a,  u2)u(a  -  vi)u(a  -  v2)dvidv2  ,  (8-1) 

Jo  Jo 

where  — oo  <  a  <  0.  The  input  space  Uq  is  the  space  of  real  valued  L2  time  functions  over 
(—oo,0]  and  Yq  is  the  Banach  space  of  real  valued  L2  time  functions  over  (— 00, 0].  Also,  the 
kernel  /  satisfies 

f(t,  iq,  V2)  =  0  for  v\  <  0  or  V2  <  0,  (8-2) 

which  is  the  usual  causality  condition.  The  £2(^0,  Lo)  norm  will  be  used  on  iq.  It  is  shown  in 
Appendix  B  of  [10]  that  if  /  €  Z^K3),  then  F  is  bounded.  That  is,  if 


||/t||  =  (  /  /  /  |/(t  +  cr,  vi,V2)\2dvidv2do  )  <00 

\J-00J0  Jo  J 

then 

1 1 2/o  1 1 0  <  \\ft\\  '  Iloilo  • 

Hence,  \Ft\0  <  \\ft\\.  Recall  from  (2-8)  that  \F |  =  supt[FtIo-  For  Bt  =  {(!*,  Ft,  U0)},  consider 
the  space  of  causal  linear  time  varying  input-output  systems  represented  by 


Bt(yo)(cr) 


b{t  +  cr,  v)y{cr 


v)du 


(8-3) 


where  —00  <  a  <  0  and  Zq  the  Banach  space  of  real  valued  L2  time  functions  over  (— 00, 0].  A 
sufficient  condition  for  B  to  be  bounded  is  b  G  L2(^2)- 

The  generalized  adjoint  system  :  Yq  — >  Uq  of  Ft  is  given  by 


Ft(B0)(u0)(cr)  =  (B0Ft){uo){cr)  =  A0(u0)(o-) 

f(t  +  a  —  v,  V2 )u(a  —  u  —  vi)u(tj  —  v  —  i'2)di'idi,2di'  .  (8-4) 

The  input-output  system  Aq  in  (8-4)  is  not  in  the  form  of  an  integral  operator;  however,  it 
can  be  put  in  that  form  by  interchanging  the  order  of  integration.  We  conclude  that 


POO 

Ao{uo){v)  =  /  b{<j,v) 

Jo 

=  [  b(a,  cr  —  u) 


(j—v  rcr-v 


—00  J  —00 

P1Z  P1Z 


f(t  +  a  —  v,  a  —  v  —  v\,  cr  —  v  —  V2)u{vi)u(y2)dvidi'2db' 
f(t  +  v,  v  —  1/1,  v  —  V2)u{vi)u(v2)di'idv2dv  , 


’  — OO  J  — OO 
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interchanging  the  order  of  integration  and  using  (8-2), 


/  max(i/i,i/2) 


b(a,  a  —  v)f(t  4-  is,  is  —  is\,  is  — 


u(v\)u{v2)dvidv2 


b(a,  a  —  is)f(t  +  is,  is  —  a  +  is\,  is  —  a  +  is  2 )dis 


'0  JO  \^J  max(u— 1/2) 

u(a  —  u\)u{a  —  U2)di'idv2  , 


(8-5) 


which  is  in  the  form  of  a  second  order  integral  operator  with  the  term  inside  the  parentheses 
in  (8-5)  being  the  kernel.  Sufficient  conditions  to  interchange  the  order  of  integration  are 
b  €  L2(K2),  /  €  Li(K3)  and  u  G  L2(K). 

We  verify  various  properties  of  the  generalized  adjoint  which  were  presented  earlier.  To 
demonstrate  that  Fa  is  memoryless,  as  given  by  Proposition  10,  consider  two  systems  Bl,B2 
of  the  form  (8-3)  such  that  [S1  —  T?2 [s>o  =  0,  for  — oo  <  s  <  0.  Then 


Fta(Bl  -  B20)(u0)(a)  =  (S1  -  B2)Ft(u0)(a) 


b2(a,iy)) 


f(t  +  a 


is,  is\,  is  2 )u(a  —  is  —  is\)u(a  —  is  —  V2)dv\dv2dv  =  0  , 


where  s  <  a  <  0,  for  all  uq  G  Uq.  Therefore,  | ( £>,)  —  Sq)|S)o  =  0,  and  Fa  is  memoryless  (and 
causal) . 

To  demonstrate  the  time  invariance  of  Fa  when  F  is  time  invariant,  also  in  Proposition  10, 
let  f(t,  v\,  )  =  f{t',  is\,  i/2)  for  all  t,  t'  G  SR.  Consider  (recalling  Rs  is  the  right  translate  from 

Definition  1  and  S*  is  the  adjoint  right  translate  from  Chapter  3) 


(• L*sFta(R*sB0))(u0)(t )  =  {Ls{RsB0LsFt)Rsu0)(a) 

roo  roo  roo 

/  b(a,  is)  /  /  f(t  + a  —  u  +  s,ui,i/2)Rsu(a  —  u  +  s  —  vi)Rsu(cr  —  i>  +  s  —  i/2)di/idu2du 

Jo  Jo  Jo 

roo  roo  roo 

/  b(a,is)  /  /  f(t  +  a  —  v  +  s,vi,i'2)u((j  —  is  +  s  —  vi  —  s)u(cr  —  v  +  s  —  V2  —  s)di'idv2dv 

Jo  Jo  Jo 


=  Fta(B0)(u0)(a)  . 

Hence,  Fa  is  time  invariant. 

Consider  the  form  of  (6-21)  for  the  system  (8-1)  of  this  example, 

G(A#)(y)(t)  =  \\yt-Ft(uf)\\  •  C(t) 


/  /*t  poo  poo  2  \  ' 

=  /  yt(v)~  /  f{a,u1,v2)u*(a  -  is{)u*{a  -  is2)du1dis2  da)  ■  ((t)  . 

\J- oo  Jo  Jo  ) 

The  form  of  (6-22)  and  (6-23)  for  this  example  is  (given  /  is  one  to  one), 

(■ Fa(B#))u(t )  =  \\Ft(ut)  -Ft(u#)\\  -C(t) 
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f(t  +  a,u  i,i/2) 
vi)u(a  —  U2)  —  u#(cr  —  v{)u#(o  —  U2 duidi'2 


1 1 2  \V2 

u(a)-u*(a)\\  da)  •<£(*)■ 


Note  F  is  one  to  one  if  f(t,  V\,V2)  /  0  V  i,  ui  >  0,  V2  >  0. 


2  \V2 

(icrj  •  C(i) 
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9  SUMMARY  AND  CONCLUSIONS 

A  generalized  adjoint  system  for  a  causal  dynamical  input-output  system  has  been  defined. 
The  input-output  system  may  be  nonlinear  and  time  varying.  The  generalized  adjoint  system 
is  patterned  after  adjoints  of  bounded  linear  transformations  in  Banach  space,  and  inherits 
various  properties  from  the  original  input-output  system.  The  generalized  adjoint  system  is 
shown  to  be  a  representation  of  the  inverse  of  the  original  input-output  system.  Finally,  the 
generalized  adjoint  system  may  be  of  some  use  in  computing  bounds  for  noise  and  disturbance 
inputs  to  the  original  input-output  system. 

An  input-output  system  is  denoted  by  a  triple  (Y,  F,  U )  where  U  is  the  input  space,  F  is 
the  system  map,  and  Y  is  the  output  space.  The  generalized  adjoint  system  of  (Y,  F,  U)  is  the 
system  (Ua,  Fa,Ya)  where  Ya  =  {(Z,  B,Y)}  and  Ua  =  {(Z,  A,U)}.  The  generalized  adjoint 
system  is  defined  by  A  =  Fa(B )  =  BF  £  Ua  for  B  £  Ya.  Note  that  the  input  and  output 
spaces  of  the  generalized  adjoint  system,  Ya  and  Ua  respectively,  are  themselves  spaces  of 
causal  input-output  systems.  The  causal  input-output  system  B  £  Ya  may  be  viewed  as  a 
time  function  by  considering  its  system  trajectory:  t  —>  Bf  .  The  spaces  Y“  and  Ua  are  to  be 
selected  and  specific  choices  were  made  to  fulfill  the  needs  of  the  report. 

The  results  up  to  Proposition  17  concern  the  generalized  adjoint  system  and  the 
generalized  adjoint  map.  These  results  include  that  the  generalized  adjoint  system  is  always 
linear  and  memoryless.  If  the  original  input-output  system  is  time  invariant  and/or  bounded, 
then  the  generalized  adjoint  is  time  invariant  and/or  bounded.  The  generalized  adjoint  map  is 
the  map  from  a  family  of  input-output  systems  T  =  {(Y,  Fl,U)}  to  their  generalized  adjoints 
Ta  =  {(Ua,Fm,Ya)}  (same  input  and  output  spaces  for  the  families).  For  bounded 
input-output  systems,  the  generalized  adjoint  map  is  bounded  and  preserves  translations. 
Under  additional  hypotheses,  the  generalized  adjoint  map  is  Lipschitz  continuous  and  is 
bounded  below,  implies  its  inverse  is  continuous.  The  Hahn-Banach  theorem  is  used  to  obtain 
this  result. 

In  the  first  section  of  Chapter  6,  Lemmas  18  through  21  show,  in  an  algebraic  sense,  that 
the  generalized  adjoint  system  is  one  to  one/onto  when  the  original  system  is  onto/one  to  one, 
and  vice  versa.  In  the  second  section  of  Chapter  6,  a  functional  analysis  of  the  generalized 
adjoint  system  representing  the  inverse  of  the  original  system  is  given.  The  input  and  output 
spaces  of  the  generalized  adjoint  system  are  not  the  same  as  the  output  and  input  spaces  of 
the  original  system.  Because  of  this,  an  auxiliary  input-output  system  (Ya,  G,  Ua )  is  defined 
which  is  related  to  the  original  system  and  has  the  same  input  and  output  spaces  as  the 
generalized  adjoint  system,  but  switched.  Define  A&  £  Ua  of  the  form 

A&(u)(t)  =  ut  —  uf  ■  ( (t),  where  (  is  an  element  of  the  equivalence  class  z,  for  some  z  £  Z, 

with  £(f)  ^  0  for  all  t,  (the  sup  norm  is  used  for  Z).  The  set  of  all  A #  is  A #  C  Ua.  A  map 
7  :  U  — ►  A &  defined  by  j(u)  =  A*.  7  is  one  to  one  by  construction.  Lemmas  22  through  27 
show  the  A#  £  A^  are  causal,  bounded,  and  uniformly  continuous  input-output  systems;  that 
7  is  monotonic,  bounded,  and  uniformly  continuous;  and  that  7_1  is  bounded  and  continuous. 
(Hence,  7  is  a  homeomorphism.)  The  map  G  is  defined  by 

G(A#)(y)(t)^\\(y-F(u#))t\\t-C(t)  . 

The  map  G  is  related  to  F  in  that  if  y #  =  F(u #)  and  A #  £  A^  and  B #  £  are  derived 
from  and  y #  respectively  as  described  above  (with  7),  then  G(A^)  =  B* .  Let  p  be  the 
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map  p  :  T  — >  Q  ( p{F )  =  G ).  Lemmas  28  through  30  show  that  the  auxiliary  systems  G  are 
memoryless,  bounded,  and  continuous;  that  p  is  bounded  and  continuous;  and  that  p~l  is 
bounded  and  continuous  in  a  coarser  topology.  We  showed  Fa  inverts  G  (hence  F )  by  defining 
an  equivalence  relation  for  systems  in  A,  [see  (6-22)  and  Figure  2],  Lemmas  31  and  32 
consider  the  boundedness  and  continuity  of  the  equivalence  relation. 

Chapter  7  demonstrates  how  generalized  adjoints  may  be  used  to  compute  noise  and 
disturbance  bounds  for  an  input-output  system.  This  is  similar  to  part  of  the  adjoints  of 
traditional  input-output  systems  (see  for  example  Laning  and  Battin  [4]). 

The  results  of  Chapters  4  and  5,  and  several  of  the  results  in  Chapter  6  are  illustrated  in 
Chapter  8’s  example  with  a  system  represented  by  a  second  degree  integral  operator.  The 
form  of  the  auxiliary  system  is  also  shown  with  this  type  of  system. 
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APPENDIX 

ON  THE  INPUT-OUTPUT  SYSTEM  TOPOLOGY 
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This  appendix  presents  various  aspects  of  the  input-output  system  topology  that  is  used  in 
this  report.  As  appendices  are  required  to  be  self-contained,  we  include  the  definitions  of 
fitted  families  (FFs)  of  time  functions,  and  other  relevant  definitions,  which  are  also  found  in 
the  main  body  of  this  report. 

Definition  A-l  ([A-l])  Let.  £  =  £(3ft,  E )  be  a  linear  space  of  time  functions  from  3ft  into  a 
Banach  space  E  such  that,  any  translate  of  a  function  in  £  is  also  a  function  in  £.  Let 
A£  =  { ||  •  II s  *  5  <  s  <  t  <  00}  be  a  family  of  seminorms  on  C  satisfying  the 

following  conditions: 

(1)  For  /1,  f2  e  C ,  if  /i(r)  =  /2(r)  for  s  <  r  <  t  then  ||/i  -  /2||Sjt  =  0. 

(2)  Let  Lr  denote  shift  to  the  left  by  r.  For  all  f  €  £,  \\LTf\\s_rt_T  =  ||/||st. 

(3)  Let  r  <  s  <t.  Then  for  all  f  G  £,  ||/||S)t  <  ||/||r>t. 

(4)  Let.  r  <  s  <  t.  Then,  for  all  f  €  £,  j|/j|r)t  <  ||/||r,s  +  ||/||Sit- 

(5)  There  exists  0  <  a  <  00  and  K.  >  1  such  that,  if  0  <  t  —  r  <  a  and  r  <  s  <  t,  then  for 
all  fe£,  \\f\\r:S<JC\\f\\rr 

The  pair  (£,  A f)  is  called  an  FF  of  seminorms  on  £.  The  normed  linear  space  formed  from 
equivalence  classes  of  functions  in  £  with  norm  ||-||st  is  denoted  HSjt.  The  elements  of  Hsj 
are  the  equivalence  classes  determined  by:  f  ~  g,  f,g  £  £  if  and  only  if  \\f  —  =  0.  They 

are  denoted  us,t,  Vs,t,  etc.  The  set  {Hsj},  —00  <  s  <  t  <  00,  is  the  FF  of  normed  linear  spaces 
given  by  (£,jV). 

For  /  6  £,  put  \\f\\s,t  =  sups<r<t  ||/||S)T.  An  FF  (£, A£)  and  {HSjt},  -00  <  s  <  t  <  00,  can 
be  augmented  to  include  H-H.^  t  by  taking  the  limit  s  —>  —00,  since  by  (3)  of  Definition  A-l 
||/||st  is  monotone  nondecreasing  as  s  — >  —00  with  t  fixed.  Let  £0  =  {/  £  £| 
lim^-oo  ||/||S)t  <00 ,16  3ft}.  For  /  G  £0,  define 

ll/ll,  Li?,  ll/ll,, ,  =11/11-00,,  •  (A-D 

With  the  meaning  of  (£,A f)  thus  extended,  ||-||st  is  defined  for  —00  <  s  <  t  <  00.  The 
left.- expanded  FF  of  seminorms  is  thereby  defined  and  is  denoted  (£0 ,  A£) .  It  still  satisfies  all 
the  Conditions  (1),  •  •  •  ,  (5). 

We  next  define  ||-||  and  iLs,oo-  F°r  an  FF)  this  is  done  by  taking  the  supremum.  Let 
1C00  =  {/  G  £o|  sup t  \\f\\t  <  00}.  For  /  G  £0 0,  define 

Jl/lls,oo  =  SUP  Wf\\s,t  ;  -00  <  s  .  (A-2) 

t>S 

It  may  be  readily  verified  that  if  (£,A f)  is  an  FF  for  indices  satisfying  —00  <  s  <  t  <  00  then, 
with  definitions  given  by  (A-l)  and  (A-2),  (£oo5AA)  is  an  FF  for  indices  satisfying 
—00  <  s  <  t  <  00  and  satisfies  Conditions  1,  2,  3,  and  5  of  Definition  A-l  for  indices 
—00  <  s  <  t  <  00.  {(£00,  A/"),  || - 1| s  t ,  —00  <  s  <  t  <  00}  is  called  the  expanded  family  of 
seminorms  determined  by  (£,  A£). 

For  /  e  £00 )  we  put 

ll/ll  =  sup  ll/ll,  =11/11-00,00  ■  (A-3) 

The  normed  linear  space  consisting  of  equivalence  classes  of  functions  in  £00  with  the  norm 
(A-3)  is  called  the  bounding  space  LI  for  the  family  {Hsj}-  For  —00  <  r  <  s  <  t  <  00,  and  g, 
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h  £  £;  the  splice  of  g  and  h  over  (r,  t\  at  s  is  defined  and  equals  /  if 

/(t)  = 

belongs  to  C.  It  is  denoted  frj,  =  gr,s+->-  hSjt ■  For  t  =  oo,  the  splice  of  g  and  h  equals  /  if 

/0)  = 

belongs  to  C.  It  is  denoted  fr,oo  =  9r,Sjr^  hs> oo- 

Let  $  be  a  mapping  from  a  norrned  linear  space  X  into  a  norrned  linear  space  Y .  As  shown 
in  Appendix  A  of  [A-3],  for  any  nonnegative  integer  N,  the  IV-power  norm  for  <I>  is  given  by 


g(r),  r  <  t  <  s 
h{r),  s  <  t  <  t 


g(r),  r  <  t  <  s 
h(r),  s  <  t 


n  T  n  A  ||$(z)|| 

Mm  =  sup  . . 

x€X  1  +  X 


(A-4) 


when  the  right  side  exists.  The  sub  ( N )  is  often  omitted  from  the  left  hand  side  of  (A-4). 

A  mapping  F  :  U  —>  Y  ,  is  called  a  (global)  input-output,  mapping  [or  referred  to  as  an 
input-output  system  (Y,  F,  U)\.  The  spaces  U  and  Y  are  bounding  spaces. 

Definition  A-2  Let  ( Y,F,U )  be  an  input-output,  system.  F  is  a  causal  mapping  and,  (Y,F,U) 
is  a  causal  system  if  and  only  if  for  all  t  and  for  all  u,v  6  U  such  that  ||u  —  v\\t  =  0  it.  follows 
that.  ||.F(u)  —  F(v)\\t  =  0. 

If  F  satisfies  Definition  A-2  it  determines  a  mapping  from  Ut  into  Yj,  denoted  Ft,  that 
satisfies  Ftut  —  (Fu)t  =  0.  We  call  Ft  a  truncated  input.- output,  mapping  and  define  the 

centered  truncated  input-output,  mapping  Ft  :Uq  — >  To  by  Ft(uo )  =  LtFtRt(uo). 

Using  (A-4)  on  the  truncated  system  mapping,  we  have 


lp[  A  1 1 -Ft  Milo 

lF4m  =  sup  — — — =  sup 


Ft  ( ut ) 


l  AT 


=  mm 


uo  1  +  IMIo  Ut  1  T  ||ut||j 
In  [A-2]  and  [A-4]  the  norm  for  the  global  input-output  mapping  is  defined  by 

[FI*  =  sup  l|i?(n)l1 


(A-5) 


u  1  +  \\u\ 


N 


(A-6) 


However,  in  this  report  input-output  systems  are  themselves  used  as  inputs  to  the  generalized 
adjoint  systems.  Therefore,  the  norm  for  the  global  input-output  mapping  should  be  similar 
to  the  norm  for  an  input,  as  in  (A-3).  In  this  report  the  global  input-output  mapping  is 
defined  by 


[F[  =  sup[Ft[0  =  sup[Ft[_oo>0  , 


(A-7) 


[A-3].  We  can  use  subscripts  on  the  operator  norms  similar  to  the  subscripts  in  (A-3).  The 
two  global  system  norms  (A-6)  and  (A-7)  are  related  by 


[FI*  <  [Ff 
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Denote  the  causal  bounded  input-output  mappings  from  U  to  Y  by  T>n(U,Y).  The  following 
lemma  (a  special  case  of  Lemma  A.l  in  [A-3] )  gives  conditions  so  T>n(U,  Y)  is  a  Banach  space. 

Lemma  A-3  ([A-3])  Let  YL^ o  and  Y  be  Banach  spaces  where  0  <  b  <  oo.  Then 
'T>N(Uo,Y-bfi)  is  a  Banach  space  with  norm  |  •  f-^o  and  T>n(U,Y)  is  a  Banach  space  with 
norm  |  •  |. 

With  (A-6)  the  definition  of  boundedness,  continuity  does  not  imply  boundedness  for  a 
linear  system,  which  is  usually  the  case.  So,  we  define  a  stronger  form  of  continuity. 

Definition  A-4  ([A-3])  An  input-output  system  ( Y,F,U ),  F  £  T>n(U,Y)  is  compatibly 
continuous  if  the  truncated  maps  Ft  are  equicontinuous. 

Our  initial  lemma  relates  continuity  with  compatible  continuity. 

Lemma  A-5  ([A-3])  Compatible  continuity  is  stronger  than  continuity. 

Proof:  If  ||u  —  u||  =  supf  ||-u  —  v\\t  <  5,  i.e. ,  ||«  —  v\\t  <  5  for  all  t,  then 
Ft  ( ut )  -  Ft  (vt)  ^  <  £,  for  all  t.  Hence,  ||F  (u)  -  F  (u)||  =  supf  Ft  ( ut )  -  Ft  (vt)  <£.  □ 
And  now  we  have  the  following  lemma: 

Lemma  A-6  ([A-3])  Let  ( Y,F,U )  be  a  linear  input-output  system.  Then  compatible 
continuity  is  equivalent  to  boundedness. 


Proof:  (i)  Consider  boundedness:  If  ( Y,F,U )  is  compatibly  continuous,  for  all  ||uo||0  =  1 
or  1 1 6uq 1 1 o  =  5 ,  (|| Ft  (<5u0)||0  <  e)  then  \\Ft  (u0)||0  <  e/6,  for  all  t.  Hence, 

hollo  5  ’ 

for  all  t,  and  (Y,  F,  JJ )  is  bounded. 

(ii)  Consider  compatible  continuity:  We  first  consider  the  observation  that  for  Ft  linear, 
the  linear  operator  norm  is  equivalent  to  (A-5).  Observe  that, 


If, i  =  sup  JLLAlk  =  sup  .  JA. 

“o  1+  hollo  u0  hollo  1+  hollo 


hi  Milo 


<sup"  V  ,7°  =  \Ft\{linear)  . 

u0  Ipollo 


ill  =  sup 


hi  MIL 


— j-  L  sup  N 

U0  1  +  hollo  ||u0||=l  1  +  hollo  IMI  =  i 

=  l  ■  sup  || Ft  (uo)llo  =  ^  •  I D (linear)  ■ 


hi  Milo  ihiMiio 

■  ,  nN  =  ..SU.P  - 5 - 


ll«o||=l 


Putting  these  together,  we  have 


hi  I  (linear)  <  hi  I  ^  hi  I  {linear)  > 


(A-8) 
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which  gives  the  equivalence.  Getting  to  the  compatible  continuity,  if  (Y,  F,  U)  is  bounded, 

1 1 N  -  Vq  )  1 1  o  <  1  Ff  |  {linear)  IN  “  No 

<  2  •  I  Ft!  N  -  Uollo  <  2  •  [F|  IN  -  nolle  •  D 

Denote  the  set  of  causal  bounded,  compatibly  continuous  input-output  systems  by 
Cn{U,  Y).  It  may  be  shown  that  if  a  =  +oo,  0  £  U,  and  U  is  closed  with  respect  to  splicing, 
compatible  continuity  is  equivalent  to  continuity  [A-3] . 

Lemma  A- 7  ([A-3])  Let  ( Y,F,U )  be  a  causal  input-output  system.  If  a  =  +oo,  0  £  U  and 
U  is  closed  with  respect  to  splicing ,  compatible  continuity  is  equivalent  to  continuity. 


Proof:  Let  \\ut  —  yt\ 


||u  H  *  0t,oo  ^  I  *  0f,oo 

K  ■  5  (independent  of  t)  such  that 

|| F  (yf  -\— >  0t,oo)  ~  F  (yf  0£iOo)  || 


t  <  6.  Since  a  =  +oo,  for  all  s  <  t,  ||ms  —  ns||s  <  tC  ■  5.  This  gives 
<  JC  ■  5.  By  the  continuity  of  (Y.  F,  U),  given  s  >  0,  we  may  choose 


F  (uf-h*  0£iOO)  77  ,'-'t 


<  £, 


)-F{v> 

and  by  causality, 


0i,oo)||  <  £■  This  gives 
Ft  ( ut )  -  Ft  (vt) 


<  e.  This  is 


compatible  continuity.  □ 

The  global  input-output  system  being  compatibly  continuous  gives  that  the  truncated 
systems  are  continuous.  This  may  not  be  said  if  the  global  input-output  system  is  continuous, 
as  demonstrated  by  the  following  example: 


Example  A-8  ([A-3])  In  this  example  a  linear  input-output  system  ( Y. ,  F,  U)  is  given  such 
that  the  global  map  is  bounded  under  (A-6)  and  the  truncated  map  is  unbounded.  Let  U  be  the 
space  of  real-valued  Lebesgue  measurable  functions  with  the  exponentially  tapered  fitted  family 
of  seminorms 


f  |u(r)|ea(t-TW  . 
J  —  OO 


(A-9) 


Let  Y  be  the  same  as  U  but  with 


\y{r)\eb(t  r)dr 


(A-10) 


such  that  —  oo  <  a  <  b  <  0.  Let  F  be  the  identity.  Since  F  is  linear,  the  ones  in  the 
denominators  of  (A-5)  and  (A-6)  may  be  omitted ,  (A-8).  Consider  the  class  of  inputs 


uT  (' t )  = 


ext ,  —  T  <  t  <  0 
=  0  elsewhere 


such  that  a  <  x  <  b.  We  have  that 


I -Pol  > 


f°T  N  b',Tdr 

1 

e(x-6)r]  °_t 

1  _  e(b-x)T 

ll-Po  NO  Ho  _ 

(x  —  b) 

Lx  —  a\ 

Nllo 

f°T  e(x~aYdr 

1 

(x  —  a) 

e(*-o)r]°r 

~\x-b) 

1  _  e(a—x)T 

Since  (a  —  x)  is  negative,  the  denominator  tends  towards  one  as  T  increases.  Since  ( b  —  x )  is 
positive,  the  numerator  becomes  larger  and  larger  without  bound,  as  T  increases.  Hence,  Fq  is 


A-6 


NSWCDD/TR-12/79 


not  bounded.  Next,  consider  the  global  map.  For  all  u  G  U,  define 


A  fp+1 

m  =  sup  /  \u  (r)|  dr  <  oo  , 
p  Jp 


(A-ll) 


for  all  p  €  K.  Taking  (A-9)  and  using  (A-ll),  we  obtain 


|tt||  =  sup  /  |u(r)|e“^  TW  >  m  •  efl 

t  J  —  OO 


Similarly  taking  (A- 10) 


\\v\\  =  sup  f  \y  (r)|  e6(t  T)dr 

t  .7—00 


Substituting  in  (A- 6),  we  see  that 


< 


m  ■  Y) 


OO 

k= 0 


ebk 


m  ■  ea 


sr^oo  bk 

=C<  oo 

pCL 


Since  C  is  independent  of  u,  F  is  bounded  using  the  [  •  [*  norm,  (A-6). 

It  is  the  author’s  opinion  that  it  is  unsettling  when  a  causal  system  may  have  a  bounded 
global  map  while  the  induced  truncated  systems  are  unbounded.  This  example  illustrates  this 
possibility  when  the  global  norm  is  given  by  (A-6).  These  types  of  systems,  in  the  author’s 
opinion,  shoidd  be  excluded  or  treated  specially.  When  the  global  norm  is  given  by  (A-7),  this 
case  is  automatically  excluded. 
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